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ABSTRACT 

This study is one of three designed to evaluate the 
effectiveness of the Onified science and Mathematics for Elemeuctary 
Schools (DSMES) program. The school study is essentially a discussion 
of the link between program dissemination and student experience, a"-^ 
discussion of the form t^ken by USMES in schools and classrooms. Part 
one is a statistical study designed to answer such questions as: How 
much time does USKES take? How much instruction in basic skills is 
afforded? Onder what conditions is inslxuction in basic skills 
maximized? What is the actual relationship between group work, 
han^s-on activities, and problem-solving processes, and success of 
sessions? Part two is nonstatistical. It consists of a general 
examination of OSMSS at five schools. The general state of USMES is 
examined from both a pedagogical and a political point of view. 
(Author/BB) 
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DESCRIPTION'oF THE STUDY 

Vs. 

Introduction 

The USMES Project conducted three studies in 1976-1977 to learn more 
aibout USMES resource teams, students, and -^-^hool implementations. The 
USMES Team Study examined the^USMES Resource Team Program and the factors 
that influenced how effective selective teams were in disseminating and 
implementing USMES. The USMES Student Study examined certain strategies 
for directly assessing the effects of USMES on students. Both the Team 
Study and the School Study are published under separate covers. 

This volxome is a report of the USMES School Study. The School Study 
is essentially a discussion of the link between program dissemination and 
student experience: a discussion of the form taken jDy USMES in schools. and 
classrooms. . 

The plan of this study is to examine this link from two distinct point s- 
of-view. Part I is a statistical investigations, designed to fi.nd general 
answers to centrally important questions concerning the use of USMES in the ^ 
classroom. How much time does USMES take? Kow much instruction in basic^ 
skills'is afforded? Under what conditions is instruction in basic skills 
■"Tnaximized? What is the actual relationship between group work, hand-on 
activities, and problem- solving processes, on the one hand, and "success" 
of sessions, on the other? As a basis for this statistical examination, 
1043 individual USMES sessions are analyzed. 

Part II of this study is non-statistical. It consists'Of a broad general 
examination of USMES as practiced at each of five different schools (schools 
"A" through "D" of the student study, and one further school, designated 
school "E"). The general state of USMES at each school, from both a peda- 
gogical and a political point of view, is assessed; then certain particularly 
significant issues are discussed "across" the five schools. 

Tdeally, ,the two main parts of this study are complements. The first 
seeks, as far as possible, to "smooth out" individual variations from teacher 
to teacher, school to school, and district to district. The unit of analysis 
"is the USMES session; many teachers, working in schools, are studied. The 
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second seeks rather to highlight individual variations. It is liinited to 
five schools, and most of the emergent "conclusions" aire hypotheses con- 
cerning the causes and effects of local variations among schools. 

Both branches of the investigation are intended to be useful in im- . 
proving local implementations of— USMES. Part 1 is 'intended to be helpful, 
for planning and documentation. Part II , it is hoped, will point to ways 
for making USMES as pleasant, rewarding, and effective as possible in a 
world of teachers, principals, classrooms, custodians, and concerned 
parents.^ It was necessary that two different populations be studied, chiefly 
because of limitations on time and funding. This fact is, of course, a 
disappointing one, since one "obvious" thing to do would be to incorporate 
statistical generalizations in our discussion of the schools of Part II. 
However, the need to employ already-availcible data for Part I made this 
impossible. 
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Part 1 Statistical Analysis 
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Statistical Analysis of USMES Class Sessions: Introduction 



From approximately 1 January 1975 to 30 June 1976, USJffiS teachers 
in the field were encouraged to report on their classroom experiences 
by means of a standard form known as the Class Session Report. The 
purpose of this form was not, primarilyr to amass statistical data. 
Rather, it was designed to afford USMES central office staff direct, 
informal "feedback" on the progress of USMES challenges in the field. 
Participating teachers were> for the most part, members of USMES re- 
source teams. A small payment was provided to compensate respondents 
for the time they devoted to making these reports. 

In all, 1043 valid reports were received. (A "valid" report, for 
these purposes, is any report belonging to a challenge of five or more 
separate sessions.) Fifty individual teachers were represented; these 
te>achers submitted from - 5 to 76 separate session reports. Seventy- two 
challenges, sequences of sessions progressing towards a solution to some 
real problem, were reported on. Members of 32 resource team components 
reported. 

The following is a facsimile (front and back) cf the form employed: 




USMES Class Session ^epo^"^ 

Name: Sesslai Date: . 

Grade Level Cs): School Priiclpal: , 

School: ^ Resource Team Maiiber 



o 



4-> 



in 
in 



c 
c 



& 

c 

o 

CO 
o 

S 



CD 
CO 



1 USMES Unit (please check one) 
Advertising DeslBnlng for Manufacturing Protect? ng Property 
=4 -1. » ,„^,-.i^ wmvor, Prv^rvM»T.innr, Mass Canrunlcatlcms School Sipplies 



USMES Unit (please check one) 

Advertising Des 1,^—10 - — ^ —— - , , 

■ Bicycle Transportation Human Proportions Mass Conrrmlcatlons School Sipplies 

Classrocn Design Dice Deslfji Nature Trails School Zoo 

Classroon Jtenagement Getting Ihei^ Orientation Soft DrlnJc 

Consumer Research Growing Plants Pedestrian Crossings Traffic flow 

— Describing People _ Lunch Lines _ PJ^ Area Design and —^^^^^S 

Indeperxientli' developed uniz, whose chailerjgc is: , . 



> i 

(a) Length of USKES session: AIVFI^: to ^ AM/PT-u 

(b) .Vumber of students in class: > nanber actively Involved: 

(c) Other adults present (please give nunber of each): 
student teachers parentn resource teachers other visitors: 

^^es other teachers curriculun special'lsts 



(d) Did the students work Ln sitall groups: Yes, No; on different tasks: Yes, No. 

Please describe briefly the sirall ^roup activities : 



(e) Did the, students participate L^. a c:^s:: dlscucsion: Yes, No; 

on group tasks : Ye 

on how recent work rela 
on futuro plans: Y 

Please- describe briefly the class discussion 



on group tasks : Yes , No , 

on how recent work relates to solving the challenge: jes, 

on futuro plans: Yes, No- 



Cover; 
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f) Did the fltutlenta woj4c on construction activities; V^s. 

in the classroom (please give mtnber of students): 



No; 



in a separate Design Ub room (please give m*nber of stucJents) : 
Please describe briefly these construction activities: 



>- 



> 
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Problein Solving Processes (pleat, 
one or Jnore- groups of students) 



check those which Jbest describe this session's work by 



Identifying and defining the problem 
' Deciding on information and Investigations needed 
' Determining what needs to b^ done first 
' Deciding on the best way to obtain the Information 
that Is needed 
Carrying out the data collection procedures 
Detecting flaws In the data g?icherlng process or 
errors In the data Itself 



Organizing, analyzing, and interpreting the data 

Suggesting possible solutions based on the data 
collected 

Trying out various solutions and evaluating the 

results 

Working to implernent the solution decided on by 

tne class 
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Basic Skills and C^r.cepts {please list those that were used in this session's work by at 
least one group of students) 



< 



mathematics skills: 



language arts skills: 

science concepts: 

social studie 



R 



H w c3o 



-'^Ul mi . V-^ITS session? (please circle one number for each statement) 



Strongly 
Agree . 



J* 

(a) The students seened to be quite interested in their work. 

(b) O-yerail^ t.^.ey rade llttl.e progress on the challenge. 

"Their investigations have been fairly superficial, so far. 

J ■rhlr. 3*»~slon included tlTe in Atiicli students 'used subject 
areu :iicills and concepts. 

(e) /-any students had experiences that should help develop their 
ir.terper::onal relations. 

(f) I had to zrr^vide str:5ng dlrecrlcn for this session's work. 



J- 
. 1 
1 



Agree Dlsa^w 

2 3 ^- 



Strongly 
Disagree 
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L"se of 



If I had not used US'SS today I wo'uld have used the tl-^e for 



'^Tjole class work. 



group work. 



in- 



di.vi±^l help. 



seat wcrk^ 



!tands-cn acti^/itie::. 



other 
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Corments (please use extra sheet for your comments) 



< 
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The form shown above, though not designed to collect statistical 
information, is actually quite well adapted to doing so. -Most of the 
process of adaptation is simply a matter of assigning missing values 
correctly. Specifically, Items (2d), (2e) , and {2f) require well- 
considered logical algorithms to distinguish between negative and miss-^ 
ing responses, and to detect anomalies resulting from tho •'hierarchized" 
question structure. For example, if a respondent to Item (2e) indicates 
that students did not participate in a class discussion but did discuss 
future plans. Item (2e) is rejected; if, however, a respondent does not 
indicate whether students participated in a class discussion, but does 
state that students discussed future plana^ class discussion is con- 
structed to have, taken place* 

Item (4), Basic Skills and Concepts r presents no real problem of 
tallying, since the mere presence or absence of an entry in each category 
is all that is record ed- ' 

Item (5) r "How Do You Feel About This USMES Session?" presented some 
problems because an early form of 'zhe Class Session Report (not shown) 
offered' a different array of response options lander Item (5) . The early 
formi offered four categories of response: strongly ^gree, uncertain, 
disagree, and strongly disagree; the later form (illustrated) offered four 
different categories: strongly agree, agree, disagree^ arA strongly dis- 
agree. About 100 reports use the early form, and the remainder use the , 
later I form. Our method Has been to collapse all replies into two cate-- 
gories: agree and disagree. Replies of "uncertain** are not counted. 

Despite- its obvious shortcomings. Class Session Report data tells us 
a great deal about .^what really happens when USMES is used in the class- 
room. Findings will be presented in' the following manner: 

• In Section 4, descriptive statfistios will be presented. That 
is, mean .values, totals, and rudimentary frequency tabulations 
will be given. • The purpose of this- section is to familiarize 
the reader in a general way with the body of data being analyzed, 
and with the extent and scope of a "typical" USMES class session. 

• In Section 5, we will explore rhe relationship between the USMES 
experience amd basic skills instruction. 

• In. Section 6, we will investigate the effects of certain prag- 
matic variables (session length, class size, etc.) on the USMES 
experience, in an attempt to formulate some rough guidelines 

to -aid the teacher in providing optimal USMES to-, his/her students. 

Thus, the following sections appear in Part 1/ below: 
Section 4, "USMES Usage in the classroom/* page 10. 
Section 5, "USMES and basic skills," page 24; su^tiary^ ^page 54, " 
Section 6^ "Successful USMES," page 55; suinmary, page 70. 
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CSMSS ' tSAGS IN T3Z CIASSRQOM; ^ A GZNSRRL D5SCKIPTI0N 



The "-tabulation of Class Session Heporiis as described in ;the previous 
session yields first of all / a set of interesting descriptive statistics 
on tJS5ES usage in the classroosi, The tabulations reccrded berow should 
serine the reader both as a, general introduction ta the sort of data which 
may secured by axialyzing Class Session Report responses ^ and as an 
■introduction to USiPGiS activities. . " 



£tepIos?n?e::t of USI^ES z:nits ' 

■ . ■ .■ 

The following tabulation reports exactly vhich units were reported 
on by the ld43 respondents, and how often each unit was employed: 



Fzequency of e:r,plovment for all z^r^lts (t^1043} 



Sessions " Percent 

Vr.lz^ '" held - of^tozal 

3icycle Transportat'ion ' 2A 2^3% 

Slassroota ^Design *7S 7.5 

. Classrton hianagenent ^ • S 0-3 

Consumer Research '162 , • • ' ' 15.5 

• Oescrxbing B<«rp?le ^ " , 3S^' , ' 3*6 

Independently Designed Units . 32^ 3.1 

Designing for Hunan Prcportiohs-. T * ^ ' . 0*7 

Dice Design " / * iC ' 1.0 

Getting There ^ '15 - .1.4 

Growing Plants ^ 7S * • 7.5 

Lunch Lines 25* 2-7 , 

.Sanufacturinc , ' , 164 , ' 15.7 

- Mass CorsnuniCf^ ~^icns S " 0.8 . 

Nat;2re Trails - - -39 , 3*7 

Orientation - ^ ; . v 42 • ^ - , 4-0 

Play Area Design and Use ^ • 14 - * " -1.3 

Protecting Property ) - 37 ' . . 3*5 

School Supplies \ . " - ' ^-^ 

School, Zoo / 110 . \ . 10.5 

Soft Drink ' ' , ' 25 ' - 2.4 

Ways to Lcam/lt:.ach " ' S6 ' 8^:? 

Weather Predictions 22 2.1 



Tota]^^ ' ^ ■'^^'^ra43 , ■ iOO.O 



/ 

The reader should understand that the nusibers tabulated in the table 
above, refer not to whole challenges conducted, but to individual class ^ ^ 
sessions held. Thus, for example, 110 classes vera hela,-in an unspecified 
nuidser of School Zoo challenges. - 

It is clear from the'^abulation above that some units were used a 
great deal 'more than others- However, the reader is cautioned that most- 
used ^mits were not always rated most successful by the teachers using 
them, and that much of the variation in frequency-of -employment above 
.results from the fact that some units were made available by USMES central 
office much earlier than others. 



Activities 



A ti^ulation of the frequency of various activities carried out in 
the course of US>SS sessions appears below* 



Freqxzency of various activities in USMES sessions 



Activity 



'Nirnier of 
sessi^jns 



Relative frequency 
of occurrence (Percent) 



Work in sr.ali 
groups 

Work on different 
tasks 

Discussion of 
group tasks 

Discussion on 
-how work relates to 
solving challenge 

Discussion of 
future plans 

Class discussion r 
all rypes 

Construction Activities 

.Construction in the 
classrcom 

ConstructiorT^n 
Design Lab 



697 
471 
510 

456 

520 

774 
441 

279 

169 



73.3 (n^951) 

65-9 (n=715) 

52.5 (n=972) 

46.9 'Cn=972) . 

53.5 (n=972) 

79.6 {n=972) 
42.3 (n=941) 

29.0 (n=1040) 

16.2 (n=1043) 
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The reader will note, in the tabulation above, that the n, varies, appre- 
ciably from item to item^ This is a reflection of the fact that not all 
questions on the form wers answered by all respondents. Also, the fol- 
lowing general observations can be made: 

• work in siaail groups occxirred very frequently (about 3/4 of 
the time) 

• construction activities took place in about 1/2 of the sessions 

- « constiTciction in the classroom was considerably more common than 
construction in design lab facilities/ and accounted for over 
' 60% of the total construction activities 

• class discussion took place in about 80% Sf the sessions 



USMES Classes . . 

USMES classes varied widely, both in class size, and in the nxmber of 
students in each class direct?.y involved, din USMES activities. The tabu- 
lation below gives exact information: 



Students in USMES 


classes 








Item 


Maximum 


Minimum 


Mean 


Median 


Size of Class 


94 


2 


26.2 


24.6 


Nunjber of^ 
students involved 
in USMES 


81 


•> 


23.3 


22.9 


Percent of class 
actively involved 
in USMES 


100% 


i.2% 


. 89.5% 


• 



The above table is interesting chiefly for tvo reasons: 

• it shows that very large and very small groups can be managed; 

• it shows that, on the average, most (about 90%) of the students 
in any class where USMES is being taught are involved in the 

• challenge. 
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^ . The liabulations below indicate the grade levels of the USMES classes 
reported on, and the range of grade levels present at each session. 



Grade 


level of USMES 


CLASSES (n=1026) 






Level 




- Sessions 




Cumulative 

frequency 

(percent) 


K 




35 


3.4% 


3.4% . 


1 




' 7 


6.7 


. 4.1 


2 




66 


6.4 


10.5 


3 




58 


5.7 


16.2 


4 




174 
38 


17.0 . 


33.1 






37.0 


70.2 


6 




20S . 


20.4 


90.5 " 


7 




85 


8.6 


99.1 


8 




9 


0.9 


100.0 


Total 




1026 


100.0 


100.0 




Range of grade levels 


in USMES classes 


(n=1038) 




Levels 


ih class 


Sessions 


Frequency 
(percent) 


Cumulative 
frequency , 
(percent) 


1 




816 


78.6% 


'78,. 6%' 


2 




201 \ 


19.4 . 


98.0 / 


3 




21 


2.0 


100.0 / 


Total 




1038 


100.0 


100. oY 

/ 

1 



The TBAdkr shoxild note that most USMES classes were at grade levels 4 
through 6, and moist sessions included students of only one grade level. 
XFor purpo'ses of ^ this study/ "grade lev^l" is tabulated at the mid-level 
of a three- level class, and the lower level of a two-lsvel class 

One^pommon concern, of newly trained USMES teachers is that they may 
be unabie, unaided- to supeirvise USMES class sessions in which diverse 
activities and group tasks cire being carried out. The following tabula- 
tion indicates how many USMES sessions were carried out with "visitors" 
(generally helpers rather than observers) , and how many without: 

y ... 



USMES sessions with visitors present (n-1043) 






Frequency 


Situation Sessions 


Ipercentl 


No "Visitors 850 


81,5% 


One or more visitors 193 


18.5 


Totals • 1043 


100.0 







The reader can see that about 3/4 of the USMES sessions were carried out 
unassist^. 

Scheduling 

One of the most significant issues in introducing the USMES curricu- 
lum into a particular school environment is scheduling. Some issues arer 

m how 'many sessions are needed for a given challenge? 

• how frequently are sessions held? 

• what' is the length of most sessions? 

• what other possible learning activities are given up to make 
time for USMES activities? , ^ ' 

The following table gives statistics on total challenge length (that 
is, how many sessions make, up a particular problem-solving "challenge"). 



Total challenge lengrth (n=1043 sessions)* 




Total sessions 
in challenge 




(percent) 


Cumulative 
fieqiiency* (percent) 


1-20 Sessions 




63.5% 


63*5% 


21-40 Sessions 




20.8 


84.3 


41-60 Sessions 




15.7 


100.0 


Total 




100.0 


100. 0 


Minimum: 5 
Maximum: 60 
Mean* : 21.9 


Sessions 
Sessions 
Sessions 






*n is number of sessions (1043) 'rather tlian number of challenges (72). , 
Presmahly this gives a clearer picture of school commitment, in terms 
of time and effort, to challenges, of various lengths. 



The figures above are based on the 1043. sessions of the study, not the 
72 challenges. For example, the table shows that 15.7% of all sessions 
conducted be.long to challenges having between 41 and 60 sessions in them; 
it is not the case that 15.7% of the challenges contained between 41 and 
60 sessions. 

. c . ' - , 

The frequency with which USMES sessions are held has long been a ' - 
matter of deep concern to central staff members. The following tabulation 
shows how frequently USMES sessions were conducted ^ among respondents. 



Frequency of sessions (n^891 sessions) * 



Sessions ger week 


Sessions 


Frequency* 
(percent) 


Cwmlative 
frequency* 
(percent) 


1 SessionA^eek 


70 


' 7.9% . 


7.9% 


1+ Session/Week 


445 


49.9 


57.8 


2+ Session/Week 


273 


30.6 


88.4 . 


3+ SessionA^eek 


38 


4.3 


92.7 


4+ 5ession/Week 


65 


7.3 


; 100.0 


Total 


891 


lOC.O 


100.0 



Mean= 2.0 sessions per week* 



*ri is number of sessions for which a mean number:- of sessions-per-week/ \ 
computed" on a challenge-wide basis, could be determined. Presumably 
such a tabulation gives the best possible . representation of school 
commitment/ in terms of time and effort, to USMES challenges scheduled 
at various internals.) ^ 



In the table above, the first category is self explanatory; the. second 
-refers to v'::as3s where one or more, but less thaji two, sessions per week 
were held in^ the^ourse'of ~ar-chailengeJ -.The Jtbii^d Refers to situations 
.where two or more but less than three, challenges were heldT'etcT" It is 
of some interest that general practices displayed here show- a smaller fre- 
quency of USMES sessions than those recorded -by respondents to the question- 
naire for team-trained teachers (reported in the USMES Team Study) . The 
discrepancy may result from the fact that some sessions (especially short 
sessions) were not reported on, and figures here were computed from the 
actual dates of classes for which, reports were submitted. 

Session -length (in minutes) , among the sessions reported on, is tab- 
ulated below. ^ ^ 

\ ■* • ■ ' 
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Session 1 GTiGth (tv^993 ) * 








Length in minutes 


Sessions 


Frequency 
(percent) 


Cumulative 

frequency 

(percent) 


1—30 Minutes 


127 


12.8% 


12.8% 


31-60 Minutes 


641 


64.6 


77.J 


61—90 Minutes 


123 


12.4 


89.7 


91-120 Minutes 


102 


10.3 


-100.0 . 


Totals 


993 


100.0 


100*0 


Mean: 61 minutes 
Median: 50 minutes 









* (Excludes a total of 50 sessions (4-8%) for which length could not be 



determined^ or which^ in a very few instances, exceeds 120 minutes.) 



One issue f pertaining to the pedagogical "cost" of doing USMES, is 
where the pecessary class time "comes from." The tabulation below lists 
six categories of activities' replaced by USMES activities. 



0 

Time employed in 


USMES session 






Item: 

"Time would have 
been used for " 


Sessions for which 
particular item 
is cited 


Percent of 
total sessions: 
(n=1043l 


Percent of 
total citations 
£n=1630l 


Whole class work 


444 


42.6% 


27.2% 


Group work 


324 


31 ;i 


19.9 


individual' Help 


355 


35.0 


-22.4 


Seat work 


127 


12.2 


■ 7.8 


Hands-on- 
activities 


206 


19.8 


. ■ 12.6 


Other activities 

\ - 


164 


15.7 


lO.l' 


Totals 

■ \ • 


1630- 




/ 100.0 



\ 



In the tabulation above ^ the first colxnnn shows the number of lOSMES 
sessions which took time away from the activity listed; the second 
column shows what percent of all sessions (that is , 1043 sessions) toolc 
time away from the paLrticular activity, the third colximn shows the 
relative degree to which each activity, by comparison to the other five, 
was cu3rtailed to make time for USMES sessions. 



Employment of basic skills ' 

One issue which of great interest to developers and implementers of 
USMES' alike is the degree to which USMES participation fosters the de- 
velopment of basic skills. Much will be said' on this subject later in. . 
this report. For the moment, it will suffice to tabulate the frequency 
with which, according to teachers* reports, USMES sessions afforded train- 
ing in basic skills. The skills are tabulated within four major categories. 



USMES sessions affording training in basic skills (n-1043) 

Sessions - . Percent of 

S^iII_categrori^_^ §5Z£^2i{^5?_5^^^^ !._^§5^i2^I§_f!S£l2S£l52-£^i^^ 

Mathematics Skills 700 . 67.1% 

Language Arts Skills 687 65.9 

Science Concepts 501 * ' 48.0 

Social Studies Concepts 650 62.3 



The tabulation above is a reasonably conservative one, since, due to the 
"open-ended" format of the USMES Class Session i^eport form, respondents 
were obliged to specify which skills within each of the four categories . 
were covered in each session. 

Since it is one of the properties of USMES that it affords training 
in more than one basic skill category in the course of a single session, a 
further tabulation was made of the -number of basic categories (out of the 
four shown cd^ove) exercised in the course of each USMES session: 
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Number of different skills categories* exercised in USMES sessions (a=1043) 



Categories 


Sessions 


Percent of . 
sessions 


Cumulative 
Qercent 


None 


52 


5.0% 


5.0% 


1 Category 


195 


18.7 


23.7 - 


2 Categories 


284 ^ 


27.2 


50.9 


3 Categories 


273 


26.2 


77.1 , 


4 Categories 






XUU* u 


Totals r 


1043 


100.0 


100.0 



It is no3;eworthy that, in about 50% of the sessions, exercise in three 
or more different categories of basic skills (as classified above) was 
afforded. ' 



Problem-solving Processes 

The central issue of USMES /in the minds of its developers, is the 
degree to which classroom experience actually affords training in problem- 
solving. Accordingly, respondents were asked to report on each session 
with respect to the following ten processes: 

DISCUSSION PROCESSES - • ' ' 

• Identifying and defining the problem - 

m Deciding on information and investigations needed 

• De.termining what needs to be done first 

• Deciding on the best way to obtain the information that is 
needed 
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INVESTIGATIVE PROCESSES 

• Carrying out the data collection procedures 

• Detecting flaws in the data gathering process for errors in 
the data itself * " ■ ^ 

• Organizing, analyzing, and interpreting the data 

• Suggesting possible solutions based on the data collected 

• Trying out various solutions and evaluating JiJie resTilts 
IMPLEMENTATION PROCESSES 

• Working to implement the solution decided on by the class • 

The employment of these processes is tabulated below, first in terms 
of the three major categories, and then in terms of the individual pro- 
cesses. , * 



Employment of problem solving processes (n-1043) 



Major 



Sessions in which process 
is^^m£lpiied 



Percent of 
samQle 



Inve stigat ive 
processes 



633 



60.7% 



Discussion 
processes 



631 



60.5 



Implementation 
processes 



449 



43-0 



Any process 



978 



96.7 
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Probl&a solving processes employed (1^1043) — ^ 

Number of sessions in which , Percent of 

Process . process was employed sessions 

Identifying and defining 

the problem 387 37.1% 

Deciding on information 

and investigations needed - 360 34.5 > 

DetermindJig what needs 

to be done first 403 38.6 

Deciding on the best way 
to obtain the information 

that is needed 353 33.8 

Carrying out the data 

collection procedures 284 27-2 

Detecting flaws in the 
data gathering process or 

errors in the data itself 213 . ' ' " 20.4 

Organizing,, analyzing^ and 

interpreting the data 281 '26.9 

Suggesting possible 
solutions based on the 

data collected 282 27.0 

Trying out various * 
solutions' and evaluating 

the results 305 29.2 

Working to implement the ^.^ 
solution decided on by the 

class 449 '43,0 



Teacher assessment of the sessions 

In order to, secure a more general xinderstanding of how successful each 
session had been, teachers were asked how they "felt" about each session, 
in terms of the following criteria: 
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• student interest 

• Progress on the challenge 

. Depth or superficiality of investigation 

• Use of subject area skills and concepts 

• Experience in developing interpersonal relations 

• Relative autoniomy and self-motivation of the class. 

- . The following is a tabulation of teacher assessments of sessions accord- 
ing to each of these six criteria. 



JTeacher assessment of session by various criteria 



Percent of session 
reports which were 

Criterion Dqsiti^/e 



The students seemed to be quite 
interested in their work 


97. 


r a 


(n=1012) 


Overalls . they made substantial 
Brogress on the challenge 


91. 


2% 


(n=969) 


The investigations have not beei* 
superficial 


81. 


:5% 


1=922) 


Students used subject area skills 
and concepts 


83. 


5% 


(n^S87) 


Many students had experiences that 
should help develop their inter^ 
personal relations 


94. 


8% 


(n=905) 


I did not have to provide strong . 
direction 


70, 


1% 


(n=965) 
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OVf^rall teacher assessment of session by all criteria (n-961) 



Nwaber of positive 

responses* 

(MAX - 6) 


Sfsssions 


Percent of 
sessions^ 


percent 


0 




0.5% 


0.5% 


1 


21 


2.2 


2.7 


2 


38 


4.0 


6.7 


3 


87 


9.1 


15.7 


4 


169 


17.6 


33.3 


5 - 


201" 


20.9 


54.2 


6 


440 


45.8 


100.0 


Totals 


961 


100.0 


100. G 


*See preceding table 


for separate listing of 6 criteria. 





The reader can see from the tabulation above that two-thirds of the sessions 
vere positively judged, by at least five out of .six criteria* 
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USKES AN5 BASIC' SKILLS 



A part:icularly--x(rgent: concern in the minds of adniriistrators, cur-- 
riculum developers, and parents alike/ is that basic skills and concepts 
ih areas such as n-.athematics, langxiage arts, science, and social studies 
be well taught, clearly reported, and accurately accounted -for. From 
very early in the life of tiie USWBS project, its developers have believed 
that' processes*: of inquiry inherent in real problem-solving provide not only 
a desirable* degree of student motivation, but also a context for effective 
ana integrated' presentation , of basic skills and concepts , 

Any' attesjpt to-^nfirm or deny, by objective means, this plausible 
but largely si5>3ective conviction, must deal with sobering difficulties, 
both pracrical and theoretical. Aaong them are the following; 

• The use of standardized tests, an obvious method for gaining 
information about student achievenent in basic skills, presents 
methodological problems. First, the scores of aill students, * 
whether or not they receive USMES training, are constantly 
changing as the students grow. Thus, testing students "before 
and after" they receive the USMES ** treatment" is not, by in large, 
a useful method- Second, there are sufficiently many variables 

- {such as teacher, school, grades, "tracking", etc/) whTch have 
a dramatic effect on standardized test scores, that also directly 
affect the administration of the USMES curriculum , th^t even the 
grossest effects of basic sVilis instruction through USMES may be 
obscured* ^ ■ . ' . . ' 

• The sise of classroccn onservers, another obvious method, presents 
practical proiiXems. First, it is costly. Second, observers must 
deal with the different ways In wh::.ch basic skills instruction is 
classified in different situ^tions^*^ and merge- results from different 
schools. Further-^ there is scse evidence Ccontair^cd in this study) 
that t^e presence of a %^isitor somewhat depresses the level cf basic 
skills instruction in an USKES classroom, 

• Self-evaluation by teachers can be used; however, it may not give ' ^ 
valid information, at least concerning the ebsol'Jte nvmber of skills 
treated in each session. That is, since the basic skills instruc- 
tion entailed in real problem-solving challenges is dynamic and not 
deterministic, assessment of skills ^.d concepts treated must be. 
carried cut retroactively for each session. Thus, individual teachers 
may be inclined 'to report all allusions, however peripheral , to basxc 
skills and concepts^ thus generating ir.flated statistics on the 
amount 'Cf bas'ic skills instruction. • 

m When basic skills instruction takes place in an USMES session, it 
is difficiilt fci- anycr.C' to assess whether^ t Iris has Y.a.'o^T'.^^ "because 
of" or *"in spite oV^ the distinctive features Of USMES real problem- 
solving^. It^Tj^ght argued that ,:ny activity -which places young 
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children in a room with a skilled tea'cher will result/ perforce, 
in some sort" of basic instruction. Thus, it is difficult to com- 
pare the level of basic skills instruction in em USMES session 
with that which would have been provided had the distinctive ele- 
ments of the USMES curriculum not been eii?)loyed. 

In view of these .problems , the present study takes the following ap- ^ 
proach. Self-reporting is used; hoWever , the USMES experience is separated 
into several aspects , and the frequency of skills instruction in the 
presence of each separately analyzed. Thus, the relative frequency of 
basic skills instruction in the presence of each aspect cetn -be compared 
with the frequency^of basic skills instruction in its absence. When this 
is5 done, self -reporting techniques can be employed witii increased confi- 
dence, since any "inflation" of the absolute- frequencies is automatically 
corrected for. Thus, with respect to each aspect, both a control group 
and a treatment group exist within our sample of USMES sessions. Nafeiurally, 
the statistical results of this sort of investigation niust not be misused. 
In particular, although tests of . significance are used throughout, they 
should not be taken to demonstrate causal relationships between individua:l 
aspects and particular effects. It is p,^krt of the nature of the USMES ex- 
perience that these individual aspects occur interdependei^tly. The task 
of discriminating among causal relationships on an individiial basis goes 
beyond the scope of the available data sample • * ' . 

An interesting conceptual problem in the treatment of this data is the 
choice of unit-of-analysis. We have chosen, for various reasons, to employ 
individual class sessions (rather than, say, individual teachers, individual 
schools, particular U£>SZS units, ot completed whole challenges) as our unit- 
of-anaiysis. There can be no doubt that this method has its drawbacks. • For 
example, it. might be argued that our analysis really explores the effective- 
ness of varous "methods" of .teaching USMES {method<:; incorporating particular 
aspects of USMES to varying degrees) and that to treat" thirty sessions given, 
by a pairticular teacher as sainpling thirty different methods is to generate 
an unreal istically large n which leads ro inflated results in tests of ^ 
significance. It seems to us, however, that: we are not in fact analyzing 
•^methods" of teaching USMES; "methods" actually used by teachers for con- - 
ducting USMES challenges are far more than mere ways of maximizing the ap- 
parent "success" of each individual session. Likewise, since self-reporting 
is used, systematise errors of assessment {raSer error) would have far more 
serious distorting effects if any unit-of-analysis which lumped together 
reports made by the same individual (that is, any of the other possible units 
listed above)- were used- 

The problem of teacher bias (since teachers were being paid by the USMES 
project' to report on their sessions) is interesting but probably less serious 
Presumably there was a positive- bias; this can hardly be debated. Presximably 
teachers would ^consciously or otherwise) be inclined to report whatever they 
thought the US.»^!ES central staff wanted ro hear. However^ neither the report- 
ing teachers in the field nor , the central staff members administering the 
report system could have known that, months later, these open-ended reports 
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vould be subjected to statistical analysis for contrasts in observed suc- 
cess \inder different circximst-tnces. At the time reports were gathered, ail 
classes were regaorded as receiving the ."USMES treatment" to the same degree. 
Thus, though bias may have existed, it seems unlikely that it could have 
distorted the results we are particularly concerned about. 

Responses to the Class Session Report allow us 'to break down the USMES 
experience either in terms of problem-solving processes, orL in terms of 
classroom activities. v 

» 

BROKEN DOWN BY PROBLEH- SOLVING PROCESSES: 
( Discussion Processes ) 

• Identifying and defining the problem. ; ' 

• Deciding on -information and investigations needed. 

• Determining, wh^t needs to be done first. 

• Deciding on the ^best way to obtain the information that is needed. 
(Investigation Processes ) 

• Carrying out the data collection procedures. 

• Detecting flaws in the data gathering process Tor errors in the 
data itself. ^ ^ 

• Organizing, analyzing, and interpreting the data. 

• Suggesting possible solutions based on the data collected. 

• Trying out various solutions and evaluating the results. 
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( Implementation Processes) 

• Working to implement the solution decided on by tne class. 
BBDKEN DOWN B^I CLASSROOM ACTIVITIES: 

• Student work in small groups. 

• Student participation in class discussion. 

• Student participation in class; a discussion on group tasks. 

• Student paitticipation in a clciss discussion of how decent work 
relates- to solving the challenge; 

• Student "participation in a. class discussion of future plans. 
m Student work on construction activities. ^ 



USME^S (Viewed as a Collection of Problem-Solving' Processes) and its 
Relation, to Basic Skills Instruction 

The schemata given alxDve provide for ten two-way partitioning s of 
the Class Session Report data according to problem-solving processes. 
Training in basic skills and concepts, as reported in Section 4 of the 
Class Session Report, can be assessed according to each partitioning. 
One expe'cts the results -o be quite "conservative," since the fonnat of 
Section 4 insists on a response in terms of specific skills and concepts, 
under the following headings: 

• Mathematics Skills 

• Language Arts Skills . ■ 
m Science Concepts 

• Social Studies Concepts 

In tabulating, we have recorded only whether amy mathematics skills instruc 
'tion, language arts instruction, etc*, takes place within a given session, 
and do not which skills, or how many skills aire actually cited. This will, 
we hope, •'smooth'* differences in terminology among schools and teachers. 

We recall, from the previous section of _ this report that the overall 
frequency of instruction in each of the four skills categories is as fol- 
lows.: 
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USMES sessions affording training in basic skills (n^l043) 



Sessions Percent of 

Skil-l category employing ^kill sessions employing skill 



Mathematics Skills 
Language Arts Skills 
science Concepts 
social Studies Concepts 



700 
687 
501 
650 



67,1% 
65,9 
48,0 
62,3 



What follows i3 essentially a tabulation of the same statistic, except that 
it is reported ^separately for sxibgroups in which each of the ten problem- 
solving processes is,, or ±s not, employed. Thus, for example, considering 
the problem- solving process "Identifying ahd defining the problem," we see 
that there are not merely four percentages given (one for each basic sJcill 
type) , but eight: one for each basic skill type, both in the presence and 
in the absence of the process "identifying and defining the problem,'' Here 
is the tabulation: 
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Perce/2 1 Sessions Affording Exercise in Basic Skills and Concepts} 
with and without selected Problem-Solving Processes (n-1045) 







jrercen c ox 


Jrercen c or 


jtrercenu ox 








Sessions 


Sessions 


Sessions 


Sejssions 






Exercising 


Exerci sing 


Exercising 


Exercj. sing 






na ^neina c jl cs 


language 






Processes 




Skills* 


Art Skills* 


CcncaQts*" 


Concepts* 


Identifying and defining 


no . 


70.1% 


62.9% 


48.0% 


58.4% 


the problem 


yes 


62 Jo 


70.8 ' 


48.1 


' 69.0 


Deciding on information 


no 


68.2 


61.2 


47.0 


60.0 


and investigations needed 


yes 


65.0 


74.7 


50.0 


• 66.7 , . 


E)etennining what needs 


no 


67.5 ' 


63.3 


48.0 


61.9 


to be done first 


ye's 


66.5 , 


70.0 


48.1 


63.0 


Decidino on the best wav 


ro 


66.4 


64.4 


48.3 


60.7 


to obtain the information 


yes 


68.6 


68.8 


47.6 


65.4 


that is needed 












Carrvincr out • the • data 


no 


60. 7 


64. 3 


48.8 


, 64.3 


collection procedures 


yes 


84.2 


70.1 


46.1 


*57.0 


Detecting flaws in the 


no 


63.4 


64.2 


47.8 


62.4 


data gathering ' process 


yes 


81.7 


72.3 


48.8 


62.0 


or errors in the data 












'itself 












Organizing, analyzing / 


no 


61.4 


64.3 


47.8 


63.3 


and interpreting the data 


yes 


82.6 


70.1' 


48.8 


59.8 


Suggesting possible 


no 


62.7 


63.3 


46.1 


62.2 


solutions based on the 


yes 


79.1 


72.7 


53.2 


62.8 


data cpllected 












Trying out various 


no 


62.6 


64.0 


44.0 


61.3 


solutions and evaluating 


yes 


78.0 


■"■70.5 


57.7 


64.9 


the results 












Working ' to implement the 


no 


60.8 


65.8 


45.3 


65.2 


solution decicZed on by 


yes 


75.5 


65.9 


51.7 


58.6 


the class 













*ColuiDn totals are not meaningfu] here, since the^ 10 processes given are not 
mutually exclusive 
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The cells in the table may be read 'as'TPBllows. Let us consider the pro- 
cess "carrying out the data collection procedures and its possible 
association with instruction in language arts skills, we observe that, 
in sessions where "carrying out the "data collection procedures" did not 
take place, instruction in language arts skills occurred in 64.3% of the 
cases. Thus it would appeao: that, if we are viewing this process as 
"treatment,"* and language arts instruction as **outcocie," the probability 
of language aaB<ts instruction curising is "incjreased" in the presence of the 
process. Two issues arise at once: 

(1) How much is the probcibility of instruction in each of the 
four -skill categories increased or decreased in the presence 
of each of the ten problem- solving processes? 

(2) VJhat is the probability in each case that this apparent 
increase or decrease shows up in our sample as the result ^ 
of chance alone? - ' 

The first question is addressed in the table below. There, the per cent 
of increase or decrease is shown, for each of the 40 possible combinations 
of skill categories and problem-solving processes. 
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Percent Increase/Decrease In NvSftber of Sessions Affording- Exercise in 
Basic Skills and Concepts In the Presence of various Problem-Solving 
Pxocesses* (n^l 043) 



Mathematics Language 



Science Social Studies Mean % 



Discussion: 

Identifying and defining 
the problem 


-11.6% 


+12.5% 


+ 0.1% 


+18.2% 


+ 4.8% 


Deciding on information and 
investigations needed 


- 4.7 


+22.1 


+ 6.4 


+11.1 

V 


+ 8.7 


Determining what needs to 
be done first 


- 1.5 


+10.6 


'+ 0.4 


+ 1.9 


+ 2.9 


Deciding on the best way 
to obtain the information 
that is needed 


+ 3.4 


+ 7.0 


- 1.4 


+ 7.8 ' 


+ 4.2 


Investigation: 
Caurrying out tlie data 
collection procedures 




+ 9.0 


- 5.4 


-11.3 


+ 7.7 


Detecting flaws in the data 
gathering process or errors 
in the data itself 


+28-9 


+12.6 


+ 2.1 


- 0.7 


+10.7 


Organizing r analyzing/ aind 
interpreting the data 


+34.4 


+ 9.0 


+ 2.1 


- 5.5 


+10.0 


Suggesting possible solutions 
based on the data collected 


+26.0 


+14.8 


+15.3 


'+ 1.0 


+14.3 


Trying out various solutions 
and evaluating the results 


+24.6 ^ - 


+10.2 


+31.0 


+ 6.0 


+18.0 


Implementation : 

Working to implement the 

solution decided on by the 

class 


+24.2 


** 

+ 0.2 


+14.1 


-10.1 


+ 7.1 
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The general situation is now quite clear. All ten problem-solving pro- 
cesses seem, on the -whole, to entail an increase in basic skills instruc- 
tion. This iray te seen from the fact that all-entries under "Mean % Change" 
ir? the tab7.e ed^ove are positive. More specifically, instruction in Mathe- 
me^ics Skills is somewhat less likely in sessions where there is problem- 
- iT ; ,L »g discussion, but very much more likely in sessions where investigation 
-. r .r.vl >menta"tion processes take place. Language Arts instruction is facil- 

. ^^v:. r> a' moderate degree (about 100%) by each of the ten processes- In- 
struction in Science Concepts is similar, except that it is very much more 
likely in sessions where there is "trying out various solutions and evaluating 
the results," and a little less likely in sessions that involve "carrying out 
data collection procedures." Treatment of Social Studies Concepts is gen- 
erally facilitated by discussion processes, and made less probable by inves- 
tigation and implementation processes. ^ c 

Some very rough siamnary figures may give the reader an overall sense of 
the magnitude of the effects shown. The mean change, for all 40 possible 
combinations, is an increase of 8.9%. That .is, in the presence of any par- 
ticular problem- solving process, the probability of exercise in each of the 
four basic skills categories is, on the .average, greater by 8.9% than it 
would have been in the absence of that process. This might seem to be a 
small amount, but the reader should be aware tha.t it applies separately to 
each problem-solving process, and to each category of basic skills. Indeed, 
for each session, t:he total effect of problem-solving processes on basic 
skills instruction might be quite large. 3.18 is the mean number of problem- 
solving processes employed in individual sessions, study-wide, suggesting 
something like a 31% mean increase (assuming independence, the factor is 
1.089-^'^^=^ 1.31) in the frequency of instruction in each of the four basic 
skills categories. (The base level over which this improvement is presiamed 
to take place is, of course, that engendered by the other features of USMES, 
such as construction activities, small group work, student autonomy, etc.)*^ 
It would appear, then, that the magnitude of- the relationship between problem- 
solving activity and basic skills instruction suggested by the present data is 
great . 

However, if one wishes to examine the individual relationships tabulated 
above, it is important to assess the statistical significance of each in-- 
crease/decrease. The tabulation which follows displays, in its cells, the 
significcince levels of the relationships observed in all 40 cases. Positive 
and negative effects are distinguished where significant of at least the .05 
level; direction of change is not shown (though small increases and decreases 
,*^ere actually observed) for non-significant results. 
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Significance of relationships between Basic Skills/ 
Concepts -^nd Problem-Solving Processes , ^ 

Mathematics Language Science 



Social Studies 



Discussion: 

Identifying and defining, 
the problem 


— 


++ 




+++ 


Deciding on information 
and investigations need 




-L I, I| 
T f 1' 






Determining what needs 
to be done first 










Deciding on the best way 
to obtain the informa- 
tion that is needed 










In'^-estigation: ^ 
Carrying out the data 
collection procedures 










Detecting flaws in the 
data gathering process 
or errors in the data 
itself 




+ 






Organizing r analyzing, 
and interpreting the 
data 










Suggesting • possible 
solutions based on 
the data collected 


4-M- 




+ 




Trying out various 
solutions and evaluat- 
ing, the results 






++4 . 




Implementation : 
Working to implement 
the solution decided 
on by the class 



















(Decrease) 


(Increase) 


Probability : * 


Probal)ilxty : * 


Blank Cell 


p > . 05 


Blank Cell 


p > .05 




p < .05 


+ 


p < .05 




p < .01 




P < -01 






+++ 


p < .001 



.♦Probability value are based on 2 x 2 Chi-Square tests. 
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Significance levels apply to individual cells, and not to the table as a 
whole. It should be understood that the general significance of the 
effect is not undermined by the fact that many individual combinations 
fail.^to achieve significance at the ,05 levels Also, since there are, in 
all, 40 cells, significance of individual effects at the .ols level should 
iiot be taken to have strong evidential value, since, where 40 tests hav/e 
been carried out, one would expect results apparently significant at the 
.05 level to appear twice by chcince alone. 

One of the most striking features of the tabulation above is the 
strong effect (at the .001 level in every case) which investigative pro- 
cesses seem to have on mathemaMcs instruction. The following table dis- 
plays this effect in more detail. 



Instruction in Mathematics Skills: Relationship to number of 
investigative problem solving processes carried out during a 
given session (n^l043) 



Number of 
investiga ti ve 
processes (out 



Sessions giving 
Instructrion in 



of 5 possible) 


N 


Mathematics Skills 


Percent 


0 


410 


208 


50.7% 


1 


256 


185 


72.3 


2 


183 


141 


77.0 


3 


91 


74 


81.3 


4 


.45 


43 


95.6 


5 - 


58 


49 


84.5 


Total 


1043 


700 ^- 


67.1 


F(5,1037) = 20.5090 




p < .001 





It is also desirable to ascertain whether each of the ten problem- 
solving processes has, as is thought by those who have developed USMES, an 
integrating effect on the teaching of basic skills (that is, a tendency to 
provide simultaneous training in several skills) . A measure that indicates 
integration, as well as total basic skill i^stinaction, is the total number 
of skills categories, of the four we are considering, involved in each ses- 
sion. The study-wide mean fcr this statistic is 2.433.. 
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Problem Solving Processes and Overall Integrative Basic Skills Exposure (n^lOAB) 

Mean Number of Skill Mean Number of Skill 
Categories treated Categories treated 
in Sessions without in Sessions with 
. ^Qtli(itu^l^a£^=^4U *sc£iri2:y-i^i:-r-41*-: — Ells,lQdlli^. 



£roces5 

Discussion : 



Identifying and defining 
the problem 



2.3948 



2.498 ; 



1-9078 



.17 



Deciding on information- 
And investigati^Qiis needed 


2. 3646 


2.5639 


6.8335 


<.01 


Determining what needs to 
be done first 


2.4063 


2.4764 


0.8835 


.35 


Deciddng on the best way 
to obtain the informatiion 
that is needed 


2.3971 


2.5042 


1.9471 


.36 


investigation : 
Carrying out the data 
collection procedures 


2.3808 


2.5739 


5.6208 


<-.05 


Detecting flaws in the 
data gathering process 
or errors in the data 
itself 


2.3783 


2.6479 


9.0060 


< .01 


Organizing r analyzing , 
and interpreting the data 


2- 3675 


2.6121 


8.9835 


< .01 


Suggesting possible so^ 
sions based on the data 
collected 


2.3430 


2.6773 


16.9428 


-C.OOl 


Trying out various i^olu- 
tions and evaluating the 
results 


2.3184 


2,7115 


24.7413 


< . 001 




Implementation: 
Working to implement the 
solution decideci on by 
the class 


2. 3704 


2.5167 , 


3.9843 


<.05 


*Based on a one-way analysis of 
variable, mean number of skill 


variance with 
categories as 


presence of activity as 
dependent variable . 


independent 
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As the reader can see, all ten problem-solving processes appear to be 
positively related to basic skills instruction ^ since in all ten cases, 
the mean number of skiJLl categories treated is greater in the presence 
than in the absent of the process. Furthermore, seven out of the 10 
processes are individually significant at the .05 {and in some cases the 
.001) level. Thus, it would appear that the effect of each process on 
skills instruction in general is generally integrative and f acili tative. 

In an attempt to assess further the actual character of the effects 
involved, we have tabulated the ten processes cited above by three major 
process types: discussion, investigation, and implementation. Compila- 
tions following this framework, like those following the t'en-way framework 
used aObove, show generally positive effects. 



Problem^Solvlng Processes Types and Exercise In Basic Skills 



Percent of Percent of Percent of Percent of 

sessl on s sessl ons sessl a ns sessl ons 

exercising exercising exercising exercising 

Problem Solving ^ Mathematics Language Science Social Studies 

E£2£SSS^IilS£ SiSiiiS. dr£S«S^fiiiS-£2{2£§2£S £22£S££S 



Discussion 
Processes 



no 



ves 



71.6^ 
64.2 



58.1% 
71.0 



44.7% 
50. 2 



52.2% 
68.9 



Investigative 
Processes 



yes 



50.7 



59.5 39.8 
70.0 53.4 



60.2 
63.7 



Implementation-, 
Processes 



no 



ves 



60. S 



^5.5 



65. S 



65.9 



45-3 



51.7 



65.2 
58.6 
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Signifdcance of Rolationships between Probl'^orrr'Solving Process 
Are^s and Exercise in Basic Skills Areas {n^l043) 



Mathematics 



Language Arts 



Science 



Social Studies 



Process Type 


Skills 


Skills 




Concepts 


Concepts 


Any 

Discussion 












Any 

Inve s ^ igat i on 


+++ 








Any 

Implementation 











Probability* that difference 
is due to chance alone 
(negative correlation ) 



Probability* that difference 
is. due to chance alone 



Blank Cell 


P 


> 


, .05 


Blank Cell 


P > .05 




P 


< 


.05 


J. 


p <. .05 




P 


< 


.01 


-M- 


P < .01 




P 


< 


.001 




p < . 001 



♦By One-Way analyses of variance, F(l,104l), with Use of Process as 
Independent Variable^ Use of Skill as Dependent Variable - 



These tabulations, analogous to the ones presented earlier^ show the effects 
and significance: levels which emerge when particular basic skills cind types 
of real problem-solving pro'^^^e.^ses are considered together. For example^ 
those sessions in which no investigative processes took pJace afforded in- 
struction in mathematic skill 50.7% of the time. Those in which one or more, 
processes took place afforded instruction 77.7% of the time. This relation- 
ship is clearly a positive cne^ and (referring to the second of the two 
tables) is significant at the ^,001 level. It is interesting to observe that 
statistically significant negative effects do appear in two cells* This 
ser^/es both as a caution (not all activities which riay arise facilitate all 
categories of skills instruction) ^ and an encouragement {clearly the positive 
results we do see are not chere merely because some teachers fill our question 
naires more optimistically than others). In some instamces^ of course^ 
teachers are simply unaware of rhe roles played by certain kinds of activities 
in particular formal disciplines. For example, "identifying and defining the" 
problem" may entail the definition of variables, a mathematical operation 
which is not always recognized as such. 

A tabulation showing overall basic skills activity^ and employing this 
3-way decomposition of problem-solving activities, . follows. 
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Pzohlesz Sol*j'lng Processes (Groupeu/ ar.d Basic Skills Sesszo^ns) 



of skill 



of skill 



zy p&s exercissc cypes Bxerczsed 
In sessJ.or:s 



Ir, s&ssicns 
virh 



Pro<ress 


Process 


p.roces3 








pit 


Di'scusslor. ^ ^ 


2.2646 


2 . 5436 




14. 2586 


< 


.001 


Any 

I:nves t:i ga z ior. 


•2.1042 


2.6477 




56.54C1 


< 


.GGl 




■. 2. 3704 


2. 5167 




3. S843 _ 


< 


.05 1 



♦Based on cne-vai^ analysis or v^araar.ce wlt^n use cf as'lrriviry as Indepei:denc 
'Variable, Xur±:^er of SxjlIIs Ca::ecories Usee as ' Dependent Variable. 



As-rhe reader car. cill :;h:ree 'classes of pror>les:-:SclV2.ng acrivlty appear 

rc have pcs^^r^v^ -::ffects, si^-nif ^LC-sr.":: co at: leasr 'tihe .05 level. 

USHES -'cor^ceived zr, terras of olassrocc^:: accj.' v^^ries; ai:d ^r:szri:czzcr: in Basic 
Skills 

As xn,dxcatec: earl::.err i:: alsp is possible rc par^irion Xhe US>!ES experi^ 
ence in rems of ciassrccr^ activicy {ratiher ^han, above, i.-: terxas of 
probiecj-solvir.g processes) . Pexhaps the sir:piest wayro assess the effecr 
of each type of activ:it:y perform, a T-rest:. .ccsipariTic rhe nean number 

c? basic skills CcJ?:<^cries dealt vrrh per session ir. r^ne presence ^ and in 
rhe absence of, each accivaty. The rabularions tihat: fellow show rhe effects . 
'of ss:ali group ac^^ivi^:ies* st:u^!erj:^-i---cor)c on different t:as>:s, and consrrac-; 
Irion accivitres.. upon_j:i::,:jo-rt^^ s?cills inscrucrion. 
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Overs 1 1 Zt2S ztucz^ on z n 


3a^ic Skills, wizh wltlnout 


Small Croup Actlvlzles^ 
















(Pooled Variance Estlma-te) 




Mean number of 






skill categories 


T 2-TAlL 


5£2E£_ 


s-^ait with 


Value DF Probabilitii 








small Qroup 






activities. 257 


2.19C7 








-4.63 948 < .001 


Sessions with 






SEiall group 






activities 693 


2.5301 







on In Basic Skills, in sessions 


with and w^r.hoizi: 


diversity of casks 








T-Tesz 






{Pooled Variance Estlniate) 




y.ean nizmber of 






skills categories 


T 2-TAIL 


Grovp 


dealt with 


Value DF Probability 


Sessions not: 






involving studenr 






work on different. 






tasks 


2.2S23 








-4.68 713 <.001 


Sessions 






involving student 






work on different 






tasks 


471 2-7006 A 
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Ovexall 'Instruct! 


on In 


Basic Skills Construction Activities 
















(Pooled Variance Estimate) . 






Mean^number of 








sJcills categories 


T. 2" TAIL 


GTOU2 


N 


deal t wi th 


, Value DF Prohahilltxi 


Sessions without 








construction 








activities 


500 


2.3080 










-4.27 939 - -J. 001 


Sessions with 








construction 








activities 


441 


2.6281 





As the reader can see, each item shows a positive effect, and significance 
at the .001 level. Clearly these three chairacteristic USMES classroom 
activities^ — group work, task differentiation, and .construction — do' entail 
conditions which facilitate basip skills instruction • , (The reader is 
cautioned^ by the way^ that these statistics do not justify the inference 
that there are three independent cause-and-ef f ect relationships at the 
significance levels shown. It is obvious that the activities cited are 
not/ even in principle, independent; still, the presence of each activity 
either is or entails a condition which facilitates basic skills instruction.) 

The :tzZect. of class discussion appears to be positive as well,, at the 
.05 level. 
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Overall Instruction in Basic Skills in Sessions with and 
without Class Discussion 

T-Test 

(Pooled Variance Estimate) 

Mean number of 
skills categ'ories 

dealt with per T ' 2'rTAIL 
^S2\iE^ « « ^ session Value DF Prohahilitu ■ 


Sessions with 

class discussion 700 2.5234 


2.45 969 <.05^ 


Sessions without 

class discussion 201 2.2985 
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The effect shown above is positive -but not especially strong • Fortunately^ 
somewhat more exact infczmation on the types of discussion carried out is 
available/ and can provide clearer information on the natuxe of the positive 
effect. ' *. 



Overall Instruction In B^lsIc Skills; iRelationshzp^ to / 
DiscxjLSsion of Group Tasks \ . / 

lyTest 

(Pooled Variance Estimate) 
Mean nuzaber / 
of skills 

categories dealt T / 2-TAIL 
Group • N* with per session Value DF ProhabilitTJ ; 


Sessions ^ith 
discussion of 
group tasks 


501 


/ 

2.7333 


/ 

3.96 608 <.001 


Sessions with 
discussion, but 
not of group 
tasks 


100 


2.2600 


{ 







Overall Instruction in Basic Skills; Relationship to 
Discussion on How Recent Work Relates to Solving the Challenge - 

T-Test 

(Pooled Variance Estimate) 

Me:m ni2inber 

of skills , . . ^ ■ 

categories dealt T 
Group N* : with per session , Value DF Probability^ 



Sessions^ with 
discussion of 
how recent work 
relates to solving 
the challenge 456 



2.6996 



Sessions with 
discussion, but 
not of how recent 
work relates to 
solving the 
challenge 115 



2.3391 



3.08 



569 



<.01 
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Overall Instruction in Basic Skills i relationship to . 
Discussion of future plans / 

T-Test 

*- . (Pooled Variance Estimate) 
Mean Number ■ . - 
of skills . ■ " 
categories dealt T 2-TAIL. 
Group N* with per session v Value DF- Probal>ility 


sessions with 

discussibn . 

of future plans 


520 


2.5846 


0.10 . 595 . .9^4 


sessions with . 
discussion^ but 
not of future 
plans 


77 


2.5714 




*Not all the 770 
the discussion, 
issue. 


reports citing class discussion reported on the nature of 
N, in these tables / refers to those who did so, for each 





Clearly, discussion. cf group tasks and discussion of how recent work relates 
to solving the cxirrent challenge both entail conditions favorable to instruc- 
tion in basic skills; however, discussion pf future plans does not; what we 
observe in that case is merely a sniail, non- significant, negative effect. 

Thus, v^en one separately considers the USMES experience according to 
each of its characteristic classroom: Activities, one finds that each aspect 
of those enxnnerated on the Class Session Report form has or entails a 
positive influence on basic skills instruction. 



"Success" in USMES versus "Success" in ^sic Skills Instruction 

Though it would appear that the elements of USMES, in themselves," 
strongly facilitate instruction in, basic skills, "they are sometimes "orches- 
trated," in the USMES experience, to serve superficially quite different 
ends. .Thus, it might be argued, the elements of the USMES experience, if 
used to promote success implicit in USMES, may not be optimally applied 
toward "sucpess"«in basic skills instruction. For example, class autonomy 
and student interest, both conceived as important desiderata in the USMES 
experience f might conceivcLbly be unimportant (or indeed, detrimental) in 
optimizing basic skills exposure. 

It is with this concern "in mind that six criteria for "success" listed 
on the Class Session Report form, of which only one is associated with basic 
skills exposure, are tabulated against each of the foxir basic skills and 
concepts. 
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Percent of Sessions Affording Exercise in Basic Skills and Concepts, 
broken down by Relative Success of Session in Terms of Cited VSMES Criteria 

Mathematics Language Science Social studies 



Criterion 




Skills 


Arts Skills 


Concepts 


conceots 


Students' 
interest in 
work 
(n=1012) 


successful 
unsuccessful 


68.4% 
56.0 


67.2% 
64.0 


49.3% 
20.0 


63.8% 
16.0 


Progress^ on 

challenge 

(n=969) 


successful 
unsuccessful 


71.8 
41-2 


69.5 
61.2 


49.2 
37-6 


63.2 
55.3 


Depth of 

investigations 

(n=922) 


successful 
unsuc ces's f u 1 


74.4 
50.9 


68.4 
66.7 - 


49.0 
45.^ _ 


62.2 , 
59.6 


Time for 
subject area 
skills cind 
concepts 
(n=887) 


successful 
unsuccessful 


76.4 
45.2 


73,8 
45.2 


52.1 - 
28.8 


64.0 
47.9 


Development of 
interpersonal 
relations 
{n^905} 


successful 
unsuccessful 


70.4 
53.2 


70.0 
59.6 


49.1 
36.2 


63.3 
31.9 


Self-motivation 
and direction 
(n=965) 


successful 
unsuccessful 


72.8 
58.8 


68*3 
65.7 


53.7 
35.3 


69.1 
47.4 
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The results are strilcLng. In all of the 24 comparisons made, a positive 
relationship is observed- This in itself indicates a strong overall re- 
lationship between reports of "success" defined , in USM]?S terms and reports 
of "success" in terms of baisic skills exposure. Moreover, many of the in- 
dividual items in the table above show statistical effects that are indiv- 
idually significant. The following tabulation gives a significance level 
for each of the 24 positive correlations in the table above. 



Significance levels (by Chi-sqaare test) for correlations relating 
criteria of successful USMES and exposure to Basic Skills 



Cri teri on 


Mathematics 


Language 


Science 

M jf^ ^ ^ 

- Looncepus 


Social St ucJ^e^s 
u once p^s 


students ' 
interest in work 


.2735 


.9061 


.0070 


- 

.0000 


Progress on 
challenge 


.0000 


.1469 


. 0544 


.. 1844 


■ Depth of 
investigations 


.0000 


.7198 


.4745 


.5973 


Time for 
subject area 
skills and concepts 


(.0000) 


(-0000) 


(.0000) 


(.0004) 


Development of 

interpersonal 

relations 


.0197 


.1752 


.1157 


.0000 


Self -motivation 
-and di-^^ection — 


.0000 






-rOOOO " — 






r 


— ^-eeoe — - 





Even excluding the fourth row, which redundantly deals with basic skills 
exposure and should be ignored, fully 40% of the items show individual 
significance at the -01 level. 

Conversely, the proportion of sessions rated as "successful" by at 
least five of the six criteria increases steadily along with the number 
of separate basic skills categories dealt with during the session. 
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Overall instruction in Basic Skills; relationship to 
overall success of USMES session hy six selected criteria 



Number of skills 
categories 

dealt with 
in session 



Number of 
Sessions 



Numt>er of sessions, 
rated successful 
at least five 
criteria 



Percent of sessions 
rated successful by 
at'^least 5 criteria 



0 


44 


XI 


25.0% 


1 


.182 


85 


- 46.7 


2 • 


258 


180 ' 


69.8 


3 


257 


184 


71.6 


4 


220 


181 


82.3 



Thus, in general, if would appear that "success" by USMES criteria 
strongly entails "success" in basic skills exposure, and vice versa. 
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Optimal Conditions for Basic Skills Instruction Under USMES 



For the user whose particular concern is inst-ruction in basic skills / 
it may be ^iielpful to consider some of the parameters of USMES teaching 
(session length, session frequency, class size, presence of aides, etc.) 
and their reJ^ationshxp to overall basic skills instruction. Only the most 
rudimentary comparisons have been made, but these should be enough to 
fumish the user with general guidelines. 

Let us consider these issues one by one. The following tabulation 
shows overall basic skills instruction and session , length. 



Overall instruction in Basic Skills; relationship to session len^t 

T-Test 

^ (Pooled variance Estima-fe) 

Mean number 
of skills 

categories dealt T 
Group N with per session Value 




2-TAIL 
DF Probabi lity 



Sessions of 
greater than 
average length 
(61 minutes or 
more) 



251 



2.3825 



Sessions of 
less than 
average length 
(60 minutes or 
less) 



768 



2.4714 



-1.04 



1017 



.297 



No significant effect is disclosed. 



X 



The following tabulation explores the relationship between overall 
basic skills instruction during a session, cind the total length of th^ 
DSMES chcillenge to which the session belongs. As the reader can see, 
basic skills instruction took place more frequently in longer challenges. 
This does not merely mean that more basic skills instruction took place 
in the course of long challenges / but alsa^that more instruction/ per 
session, took place. 



Overall instructiorr In Basic Skills; relationshlp\to' Length 
of Challenge 



T-Test 

(Pooled variance Estimate) 



Group 



N 



Mean number 
of skills 
categories dealt 
with per session 



Value 



DF 



2-TAIL 
Probability 



Sessions in 
challenges which 
used 16 or more 
segments of 
class time* 537 



2.5456 



Sessions which 
used challenges 
fewer than 16 
segments of 
class time* 506 



2.3142 



3.20 



1041 



< . 001 



*For all sessions, study-wide, the me-aif-Tewth of the chdlleuge-dnr-progress 



is 16 sessions. 
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One item of concern to tisers is the effectiveness of basic skills in- 
struction in USMES classes incorporating two or more grade levels. The 
following tabulation is directed to this issue. 



Overall Instruction in 


Basic Skills; relationship to number 


of crra.d.e levels 


in USMES class 










r-Test 








(Pooled Variance Estimate) 


- 




Mean nuinher 




• 




of skills 








categories dealt 


T . - 2-TAIL 


Group 


N 


with per session 


Value DF ^^^^^^i^i^y 


Sessions with 








classes 








incorporating 








more than one 








grade level 


222 


2.6982 










3.92 1036 < .001 


Sessions with 








classes whose 








students are at 






r 


a single grade 








level 


816 


2.3529 









The level of basic skills exposure does not seem to be reduced by the in- 
corporation of more than one grade level in a single USMES class. In fact, 
an increase in overall basic skills exposure, significant to the .001 level, 
is observed . 
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Total class size is an issue of some concern to USMES teachers* The 
following tabulation shows the relationship of overall basic skills in- 
struction to class size. 



Overall instruction in Basic Skills; relationship to class size 

y T-'Test 
(Pooled Variance Estimate) 

Mean nun2>er 
of skills 

categories dealt T . 2-TAIL 
Group N ' with per session Value DF ir:'ObaI)ility 


Sessions with 
class of 

26 or more* 490 2.3429 


-2.48 1012 <,05 


Sessions with 
class of 25 

or fewer* 524 2.5248 


*Mean class size, studywide, is 26. 







It is interesting that basic skills instruction seems relatively more effec- 
tive in smaller classes, and that this finding, is significant at the *05 

level. As wf? will in l-h^^ fnM n\ji -na eipr'-h-tnn^ qnrrA<^<^ ra-hinge; l^y -t-hp g;! v 

USMES critetria discussed above tend to favor larger rather than smaller 
classes—and -this result, too, is significant at the .05 level. Thus,' in 
this one instance, optimal USMES and optimal basic skills instruction are 
favored by different conditions. 
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There is some concern among US5!ES teachers and developers about the 
percentage pf^ a given class directly involved with USMES at any one time. 
This issue is addressed, in the following tabulation. 



Overall instruction in Basic Skills; relationship to 
proportion of total class involved in USMES 



Mean nuinber 
of skills 
categories deal: 



(Pooled Variance Estiinate} 



2-TAIL 



Group N 


with' per session 


Value 


DF 


Probability 


Sessions with 
89.5% of class 
or nore directly 
involved* 349 


2.4335 




V 








o.oa * 


1028 


.933 


Sessions with 
less than 89.5% 
of class directly 
involved 131 


2.454 

1 









*Mean percentage of class directly involved in USMES for all Sessions reported 
on is 89. 5% - 



As the reader can see, this variable has no significant effect on overall 
basic skills instruction, if least by the particular paortioning we have 
chosen. 
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Another issue of frequent concern has been the capability of individual 
teachers^ to conduct the complicated and diverse activities of an USMES 
session without help. In an attempt to find out whether this has any effect 
on basic sJcills instruction, we have partitioned the -sessions according to 
the absence or presence f visitors/aides • The result is displayed in the 
following tabulation. 



Overall Instruction in 


Basic Skills; rela 


tionship to the 




presence of Vlsizors/Ai 


des 
















T-Test 








(Pooled 


Variance Estintate) 




Mean nunber 










of skills 










categories dealt 




T 




GrouD N 


with oer session 




Value 


DF Prohabl lity^ 


Sessions with one 










or more visitors/ 










aides present 193 


2. 3353 






1 








-1.27 


1041 .206 ! 


Sessions with 








I 


no visitors/ 










aides present 850 


2.4553 






i 


4 



No significant effect is observed. 



Finally^ for the reader with a. special interest in particular basic skills 
items / we tabulate exatrtly what percentage of sessions in each unit provided 
exposure in each of the four basic skills categories- 
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The reader who wishes to use this table fcr purposes of unii- .selection is 
cautioned to consider not only the percentage figures shown, Lut the number 
of session reports (given in parentheses in the leftmost column) upon which 
oar figxires have been based. Where only a few sessions have been reported 
on, the reader should place relatively little faith in the/percentage fig- 
ures generated. On the other hctnd, where many s-*ssions have been reportea 
ors. it is likely that, since many teachers and many different sets of 
^-cc'omstances have been involved, the figiares given are quite general ajid 
quite reliable. *• 
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• Real problem-solving processes in USMES do seem to increase ' 
the amount of basic skills 'instruction reported. Specifically^ 
for the 10 processes studied^ the use of each ,accampanies an 
increase in the overall level of basic skills, instructions 
across four categories of skills (page 31, Mean % Chance) - 

/ - ' 

• Wh^ all 10 processes studied are individually paired with 

each of four basic skills categories: Math Skills, Language 
Arts Skills, Science Concepts, and/ Social Studies Concepts of' 
the combinations, 43% show individ*ually significant positive ■ 
effects at at least the .05 level; and 8% show negative effects 
Cpage 33, table). ^ 

• Instruction in Mathematics skills is especially strongly en- 
tailed in "Investigative" problem-solving processes. Each o€ 
the five processes studied shows a positive effect on Math 
skills instruction which is significamt tc- the .001 level 
(pages 33 and 34). 

• An increase in inteoration of basic skills instruction (mea*- 
sured by the mean number of different skills categories treated^ 
per ses;sion) is entailed by all 10 processes studied. -In seven 
out of th^ ten, this increase is individually significant at at 
least the .05 level* 

• The following classroom activities used in USMES also entail . 

an increase in basic skills integration and overall basic skills 
instrTaction, significant at at least the .05 level: Small group 
activities (p<.001). Diversity of tasks (p<: .001) , Construction 
' Activities (p^.OOl), Class Discussion (p<.05).. 
' ■ 

9 To determine whether, a "successful" session, as judged by USMES 
criteriar* is also a "successful" session in terms of basic skills 
instruction, each of six criteria for "USMES success" was viewed 
along with each of the four "basic skills" areas. In all of the ^ 
24 resulting cases^ the relationship, was positive. In half . of 
these instances., the positive effect was individually significant 
at the .01 level, (Page 43). . 

• The level of basic skills instruction in a particurar session is 
positively related to the following: number of sessions in chal- 
lenge, nximber of grade levels in cl^ss (p.<.(>01 isn both instances). 

• The level of basic skills instruction in a particular session is 
negatively related to class size (p<.05). 

m The level of basic skills- instruction in a particular session is 
not significantly related (at the .05 level) to the following: 
session length, percentage of class involved in the challenge, 
presence of visitors/aides. \ \ 

■ • '\ 
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SUCCESSFUL USMES 



USMBS teachers and their principals may wish to know -under just what 
pircumstances (class size^ length of session, etc.) an USMEIS experience * 
which is by some stcindard "optimal" can take place. While such "optimal" 
values (e.g., 47,3 minutes, 21.6 students, etc.) could in principle be 
ascertctined/ a very large data sample would be reqtjired, since perimeters 
for different grade levels and different units wo\ild probably differ 
greatly. Certainly, deriving "optimal" values of this sort is fcir beyond 
the scope of presently available data, which is based on the conduct of 
only 72 challenges. 

However, the scope" of the present sample does permit us to derive cer- 
tain basic recommendations^ (generally . expressed in terms of "long" versus 

"••short" sessions, or "large" versus "small" classes). The reader is^ 
cautioned that here, as in the previous section ^ our tests of -stati.stical 
significance are not to be taken as seeking evidence that particular 
variables are actually causes of the effects discussed* Rather, they are 
to be understood as pointing to circumstances which either cause, or on 

the whole accompciny circumstances which caust: , the 

effects cited. This, of coxirse, is consistent with the needs of a teacher 
or principal who wishes to improve, rather than ainlyze, local USMES teach- 
ing. 

The NuinJ:>er of Sessions in a Challenge 

The mean number of sessions per challenge in this study is 16. In the 
following tabulation our sample is divided into two parts, sessions from 
longer than average challenges, and sessions from shorter than average 
challenges, and the two parts are examined for the "overall success" rating 
of the sessions they encompass. (Criteria for success here are the same 
six criteria employed in the previous section. Section 5 above): 

• Student interest 

• Progress on the challenge / ' V- 

• Depth or superficiality of investigation 

• Use of subject area skills ^nd concepts 

e Experience in developing interpersonal relations 

• Relative automomy and self -motivation of the class. 
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T~Test 








(Pooled 


Variance Estimate) 






Mean nimber of criteria 








according to which 










session was favorably 










assessed (Maximum 


T 


2'-TAIL 


Grou£ 


N 


^ssible^6) 


Value 


DF: Probability 


Sessions in 










long challenges 










{challenge 










length=l6 










sessions or more) 


537 


5.1844 












2.89 


1013.57 <.,Q1 


Sessions in 








short: challenges 










(challenge 










lengt:h=15 seconds 










or less) 


506 


4.92C9 







The reader can see froi*the tabulation and test of significance that 
sessions of greater' than average length tend to be "more successful" (by 
the particular criteria used) than shorter challenges. The reader should 
be cautioned, however, that this effect cannot be generalized to some 
principle such as "the longer the better." Indeed, when a coarse par- 
titioning is used, and the whole range of session, length is considered, 
no evidence is found to support such a generalization. 
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Overall Success of USMES Session and total challenge length 
(n-961 sessions) 



Sessions rated 
successful according 
to 4 or fewer criteria 
(max = 6) 


210 
65.6% 
34-0% 
21.9% 


66 
20.6% 
31.7% 
6.9% 


44 
13.8% 
32.4% 
4.6% 


320 
33.3% 


Sessions rated 
successful according 
to 5 or more criteria 
(max = 6) 


407 ^ 
63.5% 
66.J3% 
42 ."4% 


142^' 
22.2% 
68-3% 
14.8^ 


92 
14.4% 
67.6% 
9.6% 


641 ' 
&6-7% 



Number of Classes 
in entire challenge: 



Count 
Row % ' 
Col % 

.ZQtalS l^l-Za ..2Ir4fl-.^^4irf2C 1 XQtal. 



Column 
Total 



617 208 136 

64.2% 21.6% 14.2% 



961 
100.0% 



Chi=square = 0.43587, with 2 degrees of freedom; 
Significance = 0.8042 



USMES Session Length 

For. the entire sample, the mean length of USMES sessions was foutnd to 
be 61 minutes. If the sairple is partitioned by this value, the results are 
as follows. 



V. 


Grou£s 


N 


: T-Test 
(Separate Variance Estimate) 

Mean number of criteria 
according to which 

session was favorably^ - " 
assessed _ (Maximum T 2-TAIL 
possible^S) ^ .Value - DF Probability 




Sessions over 
an hour long 


251 


5.3426 


1 — 

'3.67 467.47 < .001 




Sessions an 
hour or less 
in length 


768 


4,9727 
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As the reader can see, sessions more than an hour in length appear to 
be more "successful" than shorter sessions; this result is significant at 
the .OCU level'- A generalizing principle, "the longer the better," would - 
seem to be roughly borne out^ as the following cross-tabulation shows: 





K 

Cxosstahnlation of overall success of USMES 
session and length of session (n=314 sessions) 






Session Length 




Count 

Row 


1-30 


31-60 
.-diautss-- 


61-90 


• 91-120 
.-miautes 


Rov 


Sessions rated 
successful according 
to 4 or fewer criteria 
(max = 6) 


52 
17.8% 
44.1% 


201 
65.7% 
33.8% 


40 - 
13.1% 
33.6% 


13 
4.2%* 
15.9% 


306 
33.5% 


Sessions rated 
successful according 
to 5 or more criteria 
(max =6) 


66 
10.9% 
55.9% 


394 
64.8% 
66. 2% 


79 
13.0% 

fee. 4% 


69 
11.3% 
84.1% 


608 
66.5% 


Column 
Total 


118 
12.9% 


595 
65.1% 


119 
13. 0% 


82 
9.0% 


914 
100.0% 


Chi Square = 17.40435, with 3 
Significance = 0.0006 


Degrees of Freedom; 





Above, the proportion of sessions rated as successful by at least five out of 
sr.x criteria rises from a minimijon of 55.9%, in sessions 30 minutes in length 
or shorter, to a meLximum of 84.1% in sessions 91 through 120 minutes ..long- 

The reader is cautioned, however, that when individual criteria are 
considered^ the results are far from "smooth." 
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Percent of sessions given a positive, evaluation 
in terms of criterioni 

Number of 1-30 31-60 61-90 90-120 

sessions minute mi -jute minute minute 
Criterion evaluated sessions sessions sessions sessions Overall 



The students seamed 
to be quite inter- 
ested in their work 966 95.2% 97.3% 99.2% 99.0% 97.4% 

Overall, rhey made* 
good progress on 

the challenge 923 80.0 . 91.5 96.6 94.9 91.1 

Their investiga- 
tions have been 
fairly comprehen- 
sive ^ so far 877 63.6 81.7 82.9 95.8 81.2 

This session in*- 
eluded time in 
which students used 
subject airea skills 

and concepts 843 78.4 85.4 78.4 89.3 84.0 

Many students had 
experiences that 
should help develop 
their interpersonal 

relations 862 87.0 96.1 94.0 97.5 94.9 

I did not have to 
strong direction for 

this session's work 922 62.9 71.4 59.6 '86.7 70.5 



Thus, an attempt to discriminate too finely among sessic lengths, search- 
ing for an optimal effect, is probably unjustified. 



Small Group Work 

As the following tabulation shows, sessions in which students worked in 
small groups tended to be more successful than sessions where this was not 
the case. 
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Groups 



N 



r-Test 

(Pooled Variance Estimate) 
Mean number of criteria / 
according to which 
session was favorably 
assessed (Maximum T 

possible^S) Value DF Probapility 



Sessions in which 
students did not 
work in small 
groups, 257 



4.5564 



Sessions in* which 

students worked 

in sniall groups 693 



5.2843 



-6.14 378.45 <.001 



Of course, this does not mean that all sessions should include work in 
small groups; naturally;, challenges require some sessions which do not 
entail small group work. 

Student work on different tasks 



In general/ sessions in which students work on different tasks seem to 
have been most successful. 



GrouQS^ 



N 



T-Tesr 

(Separate Varia^zce Estimate) 

Mean number of criteria 
according to which 
session was favorably 

assessed (Maximum T 2-TAIL 
Qossible==6} _ Y^lU^ 5^ E£9^^^ili^U.^^, 



Sessions in which 
students did not 
work on different 
tasks 244 



4.9590 



Sessions in which 
-sttident-s- worked 
on different 
tasks 



471 



5.3270 



-3.28 433.16 



<.01 
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Class Discussion 

In general, sessions which incorporated class discussion do not appeax 
to have been significantly different in overall "success" from those which 
did not. 











T^Test 










fPnolfid Var'iance Estimate) 






Mean number of criteria 








according to which 










session was favorably 










assessed (Maximum 




r 2''TAIL 


Groups 


Sessions 


possible=6} 




Val ue DF Probability 


Sessions with- 










out class 










discussions 


201 


5.1841 














1.29 407,37 .20 


Sessions with 










class dis- 










cussions 


770 


5.0571 







However, when the nature of the discussions was submitted to a finer break- 
down, the following results appeared. 
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Groups 



Sessions 



, T-Test 

(Pooled Variance Estimate) 

Mean number of criteria 
according^ to which 
session was favorably 

assessed (Maximum T 2-TAIL 

possible=6) ' Value DF Probabili ty 



Sessions 
* which studehts 
held class 
discussion, but 
not on group 
tasks IOC 



4.7800 



Sessions in 
which students 
discussed 

group tasks 510 



5.2725 



-3.11 



608 



^ .01 



















(Pooled 


Variance Estimate) 




Mean number of criteria 








according to which 










session was favorably 










assessed (Maximum , 




T 




Grou£S Sessions 


QOSsible=6) 




Value 


DF Probability 


Sessions in' 










which students 










held class dis- 










cus sion"^ but 










not cibout how 










work relates 










to solving the 










cliallenge 115 


4.8174 




-3.58 


1 

569 ' < . 001 


Sessions in 










which students 










discussed how 










work relates to 










solving the 










challenge 456 


5.3509 
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T^Test 






(Pooled Variance Estimate) 




Mean number of criteria 








according to which 








session was favorably 








assessed (Maximum 


T 


2-TAIL 


Groups 


Sessions ^ssiblesi^B) 


Value 


DF Probability 



Sessions in 
which students 
held class 
discussion^ but 
not discussion 

of future plcins 77 5.3506 

1.50 595 .14 



Sessions in 
which students 
held discus- . 
sions of 

future plans 520 5.0786 



As the reader can see, sessions in which students discussed group tasks 
and sessions which students discussed how their work related to solving the 
challenge both were relativ- ' : "successful/" whereas^ sessions in which 
students held discussion ol ure plans appea.r to have been marglnal^ly less 
successful than those in wh * students held other sorts of discussions. 
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Construction activities 

Sessions in which constiruction activities took place appear to have 
been more "successful" than others. 



T-Test 

{Separate Variance Estimate) 

Mean number of criteria 
according to which 
session was favorably 
a ssessed ( Maxi mujn T 
Groups ^ Sessions ^possible=6J ^£2^:!^ 5ifi£if_ 



Sessions 
without; 
construe ti on 
activities 



500 



4,7860 



-6.72 929.50 



< .001 



Sessions 
with con- 
struction - 
activities 



5. 396S 
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crr*ict5 Loved 

Tu- following is a tabulation, oi 



"success" by grade Xovel* 



Count 
Col t 


\ Cross t3bul^ition oi" cvcriUll success of session by 
grado loval of class 

Grade L^vel 

A' 1 2 3 4 5 6 7 3 


^ Total 


Sessiions rated 
successful 
according to 
4 or fewer 
criteria 
(max*»6) 


7 5 19 20 64 83 B7 21 6 
2S.0% 71,4% 31.1^ 35.7% . 0% 24. 43. 5% 24-4% 66.7^ 


312 
33,0% 


Sessions rated 
successful 
according to i 
5 or n>cre 1 
criteria | 
(a?x=6) j 


2 *-;2 36 ' lOO 252 113 65 3 
7S. 0>. 25.6% 6S.9^ 61. OV 75-2*. 56.5% 75.6% 33.3% 


■ ., - 

634 

67.0% 

! 

» 

! 


Col. Totals; j 
Total Pet : { 


2o 7 61 56 164 33 5 20C 86 ' 9 
2,0^. 5.9^ 17.3^11 35,//; 21.1^ 9,1% 1.0% 


— ^ — 

^'J% 



~Though figures differ considerably fror:. grade to grade, no generalisation would seea 
to emerge. Grades 1 and S seen to show lower rates of success, but the' .':^^i>er of sessions 
r^-^orted on are in both cases far fever than for all other grade levels so these figxires 
c-^nnot be relied on. In any event, there seems to be no systematic effect cf grade upon 
"success" in 'CSl^S 



6; 



0~ 
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I ^ ' ' ■ {F^ol^d Varidnce Bszl^zej 

.^r.../; r:aTj:er of cr:cer-.^ 

session was /^wrisi^lw' 

assesses: i">:ai- . m.'r^ r 

Grc^pps S^ss2o::s. possj -^le^-e} valine- DF Probabilicy 

tvo or r^ore , ^ . . i 



grade level'- J?" 5-C^4:: 



Sessions vi::r. 

I one crside 
I level 



: -0,13 1036 .59 



Se^^^r^ons rrzldt'iz v::i' ..y 1 irce cl-ix-ses were r^cre ''successful" th^r. t^^osi^ 

rela::ivelv .small rl-isaes. 



least 2S 



/Separate V'aria.riC'f- frsri-r^re; 

j^e-zi-n rrsr^-e^ of crizerici'. 

':^ssesse>z '*Jax^'r?i-:jr T 2 ''TAIL 

poss^trl^^S) ; '^^L^i'z. ?S£5^£zi^B'i^^\ 



Sessions :.r, 
classes vit>. 

25 . stiucer.cs 514 
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ZZ is iiiiere sting tivsLt this result:, significant at: t:he .05 level. 
Is different frorr. the result foiu^d when basic skills instruction is 
considered- By that criteri<^ smaller classes are found to be somewhat 
better. 

Proportion of class direczly Involved in USbtES activity 

Study-wide^ the mean proportion of any class directly engaged in USMES 
activity was .395. When the saniple was partitioned into sessions where 
laore than this proportion ^ and fewer than this proportion, were involved, 
th- difference in overall '^success" was not found to be significant. 



Sessions 



T-T^st 

(Separate Variance Estimate} 

y.ean nuxrl>er of criteria 
according to which 
session was favorably 

assessed fMaxi^i^-am T 2-TAIL 
possib2e=6) ] *f5nH§ 5£ 



Sessions in 
vfhich at least, 
89.5% of class 
is directly 
involved in 



: Sessions in 



i 



which less 



I than 89 . S\ ls 

i directly ir,^ 
volvec in 



-0-5S 290. SS 
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^ r essence ^izaes / visitor 

The preser.rre of aides/visitors seer, to have little or no effect on the 
GverBil "sue ,uss'' of USMES sessions. 
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T-Tesi: 








(Pooled 


1/ariance Estimate) 




Mean number of criteria 








according to whiah ■ 










session was favorably 




*■ 




assessed CMaximxim 




T 




Groups Sessions 


^possible=6) 




Value 


* DF Probabili'ty 


Sessions with 










visitors 










present 193 


5.0518 














-.05 


1041 .96 


Sessions with- 










out visitors 










present 350 


5.0576 









This is of some interest tO; the new USMES teacher, since one anxiety 
felt by many is that they will, unaided, be unable to supervise a full 
range of USMES agcivities in the classroom. ,The tentative finding of 'this 
st.udy, that aides are not necessary, is bdirne out also by the following. 
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Crosstahulatlon of sessions including coxist ruction 
activitiBS and Sessions where one or more visitors/ ^ 
aides were present (n =941) 




1 

Count 
Row % 
Col % 


Sessions 

with 

no 

visitors/ 
aides 


Sessions 
with 

one or more 

visitors/ 

aides 


Row . 
Total ' 


Sessions with 
no construction 
activity 


403 
80.6% 
32.0 


97 
19.4% 
58.4 


500 
53.1% 


Sessions with 
some construc- 
tion activity 




372 
84.4% 
48.0 


'69 
15.6% 
41.6 ^ 


441 
46.9% 




Coluinn 
Total . 


775 
82.4% 


116 
17.6% ^ . ■ 


^^^--^..^ 941 

100.0%^^---- 






Chi- Square = 
significance 


2.02155, with 1 ^degree of freedom; 

= 0.1551 

— 



From this tabulation, ir v/ould appear that even the use of " construction 
agtivarb^es, a very beneficial but potentially "tricky" matter for new USMES 
teacher^, does cot require visitors or aides. 




Range of grades in USMES sessions 

The nvnnber of <^rade levels present in a giv.en USIffiS- session seems to 
have no significant-effect on -tJie overall success of the session. 



Summary 

Available data from t ^ Class Session Reports suggests the following; 

• Challenges of 16 s<=^ssions or longer are'more successful than shorter 
challenges. 

• Sessions at least an hour long are more successful than shorter 
sessions, and the general principle "the longer the better" is 
roughly true. 

• Sessions with small group activities are more successful than those 
without. 

• Sessions where students work on different tasks are more successful 
^than those where this does -not take- place. 

• Certain types of cla; s discussion are positively related to session 
success. 

» Sessions with construction activities are more successful than those 
without- 

• NO general -xule can be adduced which relates session success to 
grade level. " 

• The range of grade levels in a particular USMES class does not seem 
• to affect success. 

» Classes with at least 25 students seem somewhat 'more successful than 
those with fewer. 

9 The proportion of students engaged in any one session challenge seems 
to have little effect on success. 

» The presence of visitors/aides does not seem to affecr success. 
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CASE STUDY OF FIVE UStffiS SCHOOLS: INTRODUCTION 

In Spring 1977, USMES teachers, non-USMES teachers, and principals at 
five USME3 schools were interviewed. Jilthoug'h a nuinber of issues proved 
to be of recurring major importance and :a checklist of questions was used 
(see T^pendlx) f no fixed format was used i.n conducting the interviews. A 
single interviewer, the USMES project directorr conducted all^ discussions. 

The five schools have been designated "A" "through- "E." Schools "A" 
through "D" are the same as the schools so designated in the USMES student 
study. School "E" is an addition, and serves to increase the total range 
of material available for our examination and interpretation. The schools 
to be studied were selected not because they were all successful (some have 
serious problems) Dut because on the whole they display an interesting and, 
we hope, representative range of political and pedagogical developments to 
USMES both positive and negative. 

Section 8, below> is expository. It sets out a brief description of 
each of .the five schools, commencing with a description of the school itself 
and proceeding to characterize its USMES activity in each case. 

Section 9, which follows, is interpretive. It consists of a discussion 
of major issues which, we believe, xinderlie the circumstances detailed in 
Section 8. The emphasis throughout Section 9 is on generating explanatory 
hypotheses and, at aimes, direct . recommendations which may be useful to 
teachers and administrators in the field. 

Section 10 is - speculative. It consists of several discussions which 
^"go beyond" the data, proposing^ mechanisms and hypotheses which attempt to 
explain the investigative findings reported in Section 8. The material in 
Section 10 is tentative and exploratory, but will, we hope, be thought- 
provoking and practically useful. 

Sections following are: 
Section 8, "The five schools," page 73. 

Section 9, "Interpretive issues," page 84, r 
Section 10, "Speculative Issues," page 100. 
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CASE STUDIES 



THE FIVE SaiOOLS 



Schcx>l "A" ■ ^ 

School "A/' located in the mid-central part of the United States ^ has 
an enrollment of. about 300 elementary- level wtudents- The school is located 

-in a-small city (population about 50,000), and the racial/ethnic composition 

of its students is about '99% ^whiter 1% Asian The neighborhood 

contains a \iniversity; most neeirby residential structures are "expensive" 
houses. School "A" is located in an affluent district which may be expected 
to have strong interests in securing academic advancement for its students. 

Recently, USMES challenges have been carried out in mass communications, 
playground safety and improvement, advertising, designing for human propor- 
tions, manufacturing, using free time, arid other areas. 

The school does not place much emphasis on providing Design Lab facili- 
ties. A portable cart is available, but opinion is divided as to how useful 
it is. The use of teachers' aides in connection with USKES is not a signifi 
cant feature of the school's USMES policies. One second-grade teacher com- 
mented on the difficulties of conducting USMES activities with only part of 
a class, since this entailed planning something to do with the rest of the 
students during USMES time. 

Generally, science and social studies time is used for USMES activity. 
Sessions are 45-50 minutes long, and scheduled about four times a week. 
There is some feeling that these periods are "a little short," and that stu- 
dents may be frustrated by the need to stop USMES activity after only a few 
minutes. Ot;her scheduling needs are the cause of this limitation. 

No specif ic' procedures exist for teachers to report USMES activity to 
principal or district, but general reporting procedures within the district 
have -recently become quite stringent, and are expected to become more 
stringent still. One teacher reports being "swamped" by accountability 
procedures. 
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District interest in basic f:kills instruction and recent district 
directives are seen as contributing to a climate with is rather uxtcon- 
genial to the practice of USMES. This is in some respects an anomalous 
situation^ since the overt philosophical position of the district seems 
to favor real problem- solving — a real problem-solving correlates very well 
withi stated district objectives, and USMES is even specifically mentioned 
in the district science objectives. In fact, there is a deeply felt division, 
both among administrators and among parents, on the subject of innovative 
instruction; but in general it is the earlier climate which was favorable to 
USMES and is reflected in the district science objectives, and the later 
climate' which places an emphasis on basic skills instruction in a traditional 
mode. Fortunately for the USMES program at School A, however, the principal 
newly installed to "bring order" to the school seems quite sympathetic to 
USMES. 

Within School A, apparently, the use of USMES is not divisive. The 
school custodian is not offended by the students' construction activities, 
and relations between USMES and non-USMES teachers are described as "good," 
'In facte^ several "non-USMES teachers" are said to have used USMES units. 

Relations with parents are strained and in some ways unsatisfactory. 
In the . immediate past, parents have been critical of School A because of a 
lack of "specific" science instruction, and because they wish to see evidence 
of skills advancement {such as homework) and do not regard real" problem- 
solving as a matter of high priority. The negative attitude of at least 
some parents .was shovm by parental criticism of an. "amateurish" play given 
and entirely produced by students in connection with an^ USMES project. The 
fj^ct that, apparently^ some parents did not realize the play had been pro- 
duced entirely by students is a symptom of the poor communication problem may 
account for some of the parental skepticism observed. 

Many parents seem to be unfamiliar with the goals of USMES (some parents 
try to solve p^roblems for their childreni)/ but when consulted by and sur- 
veyed by one teacher, or.ly ten percent of the parents responding thought USMES 
a "waste of time." 

Clearly, however, more than communication problems are involved. There 
are in the district two mutually antagonistic parent groups which meet sepa- 
rately and espouse different policies. Further, although some parents are 
charmed by their children's enthusiasm for "real problem solving, others are 
not, and wish to be assured in advance what basic skills instruction will 
L-s provided by a given USMES unit. 

The effect of USMES on School A students is described in quite posi- ive 
terms. It was' reported tha:: "kids' inquiry skills are more defined," and 
that they "zero in on a topic" faster. It was observed that "socialization^ 
goe? on betve^^n kids" xn the course of an USMES challenge, that "slower kids 
come forward" and that students with learning problems can, in the cotirse 
of challenges, become "real leaders*" Apparently, standardized test scores 
have not been affected, positively or negatively, where USMES has been em- 
ployed instead of some other curriculum material-. 
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_ It is interesting that in the view of School A teachers r slower stu- 
dents l>enefit most from USKESr whereas the principal s-uspects that DSMES 
is "particularly suited for gifted students." This difference laay be ac- 
counted for by the fact that the principal is a new arrival from a different 
school/ where different conditions prevail. However/ it is of some' interest 
that/ throughout this study/ different but quite strongly-held views on what 
sort of students USMES was best for (faster-slower/ older-yoxinger / affluent- 
deprived) were consistently expressed at different locations. We will 
speculate be'low on the interesting issue of whether thi^ links optimal DSMES 
effects with some particular developmental stage (whether reached by gifts 
or educational opportunity) / or whether children in different schools have 
different perceptions of the autonomy seemingly offered by real problem- 
solving challenges. 

Little was said about USMES as a tool for integrating basic skills in- 
struction. One teacher characterized USMES as "a tool for the reinforcement 
and utilization of basic skillS/ but not an initiator of basic skills." 

Apparently, quite good-quality USMES is being done at School A. Since 
the new principal is fundamentally sympathetic with USMES/ and, at the same 
time/ the school is under intense pressure from groups of parents with con- 
flicting views, it struck our investigator that valuable new modes of USMES 
might emerge, in his words , "USMES may develop very nicely ana even give 
us some new models that many other schools could use." On the other hand, 
"it is possible that some cf the pressures in the school will lead to dis- 
tortions in the USMES model." Our "investigator notes that^^3S is the 
science program for the iritermediate grades / but it is used in a completely 
individualized way without groups of children working together. This in- 
dividualization, I believe, is festered because it is easier to follow the 
children's learning, and ?.lso to control their behavior." 

In summary. School A is characterized by its talented-/^., privileged stu- 
dents, and its need to -functioI^ under conflicting pressures from mutually 
antagonistic parent groups. In this situation, a mode of USMES well-adapted 
to this environment may evolve, or USMES may be distorted to the point of 
reduced usefulness- ' • 
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School "B^ 

School "B" ic located in the southwest of the United States,, in the 
vicinity of a large city (population 1.5 million). Enrollment is 800. The 
neighborhood of the school includes a shopping center and "inexpensive 
housf*s. " The racial/ethnic composition of School B students is approximately 
49% Spanish surname; 49% white; and 2% black, asian, and native americar 
combined. 

The level of USMES activity at -School B is very high, and significantly 
effects the tone of the school. Challenges are generally involved with the 
smooth and -successful operation of the school. They are concerned with 
such issues as purchasing supplies/ regulating traffic, promoting fire 
safety, improving ~ playgrounds, and many others. 

No special Design Lab srace is set aside, though tools are widely used, 
Tools axe used in classrooms (indeed, the principal suggests that Oosign 
Lab space may not be needed since the "whole building" is used) . Teachers 
are instructed in tool use, and tools are provided"" through student-raised 
funds as well as district funds- Some teachers feel chat a Design Lcib 
space would be extremely helpful . 

Time employed for US^I^S is derived from science, mathematics, and 
language axts. Of the persons interviewed, most thought there was enough 
time provided, though one thought there was too little, "because the class 
has special classes Ih hours each day. " 

USMES is evaluated along with other subjects in regular district evalua- 
tions, and the district seems to be satisfied with School 3's use of USMES,. 
though not overtly supportive of it. 

The principal of School B supports USMES with great vigor; we believe 
this is the largest si ngle f actor which accounts for the unusual strength ^ 
of USMES in School B. /This principal's discretionary power over curriculum 
is not boundless, but ''within its limits she has given USMES a significant 
pedagogical role in the school . 

The social role of USMES in School 3 is probably even more important 
than its pedagogical role^ it is felt that USMES "controls the atmosphere 
of the school/" "gives students a sense of ownership,." and "makes children 
authority figures." This xs particularly important for School B, because 
of its culturally mixed student population, and high student turnover rate. 

Apparently relations between USMES teachers and non^USMES teachers are 
good. Relations with the school custodian have remained friendly — evidently 
the custodian is "amused" by student construction activities- 

The parents of School B students are not much involved in USMES, though 
they seem to approve of the program (and in some instances have requested 
their children be .placed in USMES classes). Grade reports to parents 
characteristically take USMES into account within a particular major srubject, 
such as science or language arts. In some cases, the discipline and 
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■ cooperation -of students is reflected in student citizenship reports. 
Evidently local pressure on teachers, principal, and district administra- 
tors to justify all work in terms of basic skills instruction is moderate. 
One respondent did express a desire to see USMES "correlated within sub- 
jects" but this respondent was a non-USMES teacher who niight have been un- 
aware of the extent of presently existing correlation resources. 

The respondents interviewed, for the most part, seemed to agree that 
the effects of USMES on School B students were very positive. Students are 
characterized as "being more eager to learn," and "having a sense of owner- 
ship" in the school. Non-USJES-teachers -were^ divided--one reported-^hat"-^-- 



"kids benefit" fvom USMES, but another observed that "scores must go up 

Will making posters help?" Standardized test scores have not been system- 
atically investigated but two respondents expressed the belief that kids 
did better on standardized .tests because of exposure to USMES. 

An attempt at .doubling the number of USMES teachers in School 3 in 1976-77 
haj not been wholly successfu.^ since new USMES teachers were also newly-trained 
classroom teachers, and in many cases found USMES "overwhelming." Howeyer, 
informal peer support for new USMES teachers did prove helpful^ and the^ 
principal took an active interest in new teachers. Some respondents ex- 
pressed the wish that formal workshop training (such as that'" previously af- 
forded in St. Louis) could be given to new teachers. Teachers at School B 
who use OSMES with their students typically refer to it as a "way of life," 
or a "philosophy." Characteristically, non-UPMES teachers perceive the 
program as requiring much less training than USMES teachers^do. 

The School 3 USMES implementation is strong and vital, and a large num- 
ber of teachers at School B are now skilled enough to teach USMES on their 
own. However, the program "is not being dealt with in a positive way by 
the school district at all." Thus, the implementation is still quite 
directl/ dependent on the energetic support and personal commitment of the 
School B principal; otherwise, its future is not assured, though its present 
state is very strong. 
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School "C" 

School "C" is located in the north central part of the United States. 
The school is located in a suburb {population about 25.0CC) and is set in 
a neighborhood of "moderate" to "expensive" houses and apartsients. Student 
enrollsient is about 700. consisting of 99% vhite, 1% black and Spanish s-or- 
name combined. 

Cb.allenges done recently have been School Zoo, Design Lab Design, "row.ng 
Plants, Classroom Manage.T.ent, - Planning a carr.ping trip, and others. 

A "be~sign ias~ exisTs^ a "C" "bur' i- is- lirt-ie-jsed-. ---The lab-.is _ 

located in an unused shower room, and is characterized as "too far ana too 
isolated from classrooms" (that is, it is not possible to supervise both 
■students using the design lab and students regaining in the classroom, be- 
cause the two are spacially too far apart) . This pr.^oleni was ment nee by 
several USME3 teachers, and is quite serious, since aides "are not - -jutxnely 
provided to h^lp supervise separate groups of students. 

Tine for US.MES activities is generally provided through the use of science 
tiBie, f: e ti:r.e, ;:ome social studies tisie, and homeroom. .Tvpicclly, ^twenty 
to thirty .Td.r.utes a day nay be r.ade available, three tines a week. It is a?- 
parentlv'the orincical''s view that finding enough tine for USMZS is 
£negative3 fictor." The tirr.e ictv^ally provided is srr.all compared witn that 
in other schools. 

The iTOortance of USMES at School "C" has decreased sig.nif icantly. There 
is now no discussion of . US.vES ac the district level and there is a new strong 
emphasis in the district on traditional training in basic skills. , "-Keep 
h-.-tti.ng basic skills in nath," is the message -of current district ad.-ninistra- 
tors. Also, new controls and accountability mechanisms have been set up as 
a -eaction against earlier failure in the district to follow up numerous in- 
novative orcgrams. Despite -.he fart that real problem-solving is consiste_nt 
with the exDlicit, formal pedagogical goals of the district,, lu is now air 
f^'cult to schedule and diff:r:;lt to carry out. both because cf district fm- 
D.hasis on "basics- ar.d :: -net logging procedures. It is significant that 
funds for the p'orchase . US-'IES materials are available, but m^teria^s 
have not been bought . 

G-adirg in USME3 is not, apparently, easy, and i3 little done, though 
somf grading in science, health, and language arts incorporates stucent per- 
formance in US-MES- in ge.neral, there is little interaction between USKES 
and the rest of the curriculum, and only non-UEKKS teachers made' comments 
such as "OSMES fits in,"' and " Tthe US>1£S approach 3 is used to teacn m.any 
siibject areas. " 

Relations between those using USr-SS and others are not particularly har- 
monious, some teachers felt -hat relations were satisfactory, but others 
felt they were deteriorating. The school custodian was reportec as navmg 
been "upset by paint and animal"..'" 



"There is some positive intierest aiaong pairenzs {for example parents 
were willing to staff zhe Design Lab) but Mst interest would appear to 
be negative. ThuS/ a p.irent thought his child was in "too many" USMES 

units r and problems of grading, and reporting USMES activities to pag4?.nr^^ 

seemed to deter teachers froia the use of USMES- 

USMSS is net generally recognized as having had auch effect on School ^C" 
or its students. The principal finds the program as had "no effect" on the 
school itself.,- atnd our investigator feels that seme \studenr.s etre actxially 
"bored" by USHES as it is taught at the school. There is no indication that 
comparisons of standardized test graces have been made in an atten^t to assess 
possible effects of USMES • On the _ other hand , some teachers have., reported 
USMES units that went "very well" with their classes T and ^ in rhe view of 
our investigator, sonie School "C" teachers are teaching very good USMSS. 

It would appear thaz the nature of the studer;t population at School "C" 
is changing, A large nun±)er of "transient" students nrw pass through the 
schools and it would appear the School C teachers have difficulties in dealing 
with thesi* A nurr±>er of corments were niade cibout students who were "less 
mature r" who ''could not discxpljLne themselves," or who had to be kept— sepa- 
rated in their seats. No doubt this change is a deterrent to USMES .^ctivirv^ 
though at laast one teacher reports e?ccellent results with a "very mixed..-^^ 
class, " 

Most 'JSXES teachers at School ''C" were trained in an USJ-SSS' developrr.enw^ 
reacher workshop. There is not an active training procrai^^at School '*C" 
now . ^^'"'^ 

In general, teachers' view^s on the scope arid function of real prohlein- ; 
solving are quite cautious. Thus, one teacher feels that problem-solving 
consists in finding answers to problens posed by the teacher * through library 
work in snail groups. Another sees group leadership in USMES nOt as an ex- 
perience which xT^ay bring the retiring student out of hiLiseif, but as a role 
which iiiust be assigned to pre-'^xist ing student leaders if challenges are : to 
be successful. In another case/ the "USMES spirit" is seen as little n-^ore 
than a style of presenting individual work {such as ESS). Clearly, real 
prob.lent-solving at School ^'C includes delicate group dynarsics, since one 
successful USMES teacher observed that "kids resent being asked to plan early 
onl" It seems especially significant that student^:;; feel they are being 
"asked" rather than ''allowed" to plan. 

Tt would appear that USMES is "in trouble at School C* The reasons would 
appear to be these: First, it seezr^ that teaching staff and student popula-- 
tion at School "C" are not _con:fortable with each other: Second, it would 
appear that nany teachers nis^take parts of US>2:S for USMES itself — that is, 
they feel that USMES is an "approach" which can be used in ind5.vidi:al work, 
or in solving teacher-assigned prcblenis, or v yjt using groups, or withou'c 
using tools. 
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School *s Ic-Cdiod :.he sc.-:rh^:^i.s::<i.rr:. of zX.c 'J:: ^z^d 5-;.ar:es O-r; 

a l)ft.rge city iuapcl^^'z.xor a£>cut iSO>O0C;. ar.d : -.^ 5:.tuaxed sr^- a neighborhood 
cont^irtinq houses ci "r-c^cer^j^te cri-c^:: . 7re scnco:*? stc'^iont j>3?uiaticr: is 

' i^^iscent l^SKES urT,:.':^ n^v<: i>ef?r; concerned w;tri r:%rtn.cs. crawmg p-lancs^ 
and t>i^nr.:ir.c. -glf lower cr.ad*^^-. burclar aldtrr^s, resiirpo::: in:prov»rner,::-, 
- plsyground voric^ oind ^nir.- -.r. the higher grades. 

A G;p<rci.al Zi^ziqT; ar^u ^^i^cd :r. Sc'v:-z<:l "'C^" -line there :ls a Des-:Lgn 

La.b r5Ar:*jccr. The spac^. a^^aj^l^ai-^le 13 ade-qu-?te r-j:t screvr;at; sn.3ll for a. en- 
tire citiss. Tfe cporatior. of lab :s in general successful. The Zr^esigra 
Ixiib raanaccr is apparently quite octi.ve. sar;-et ir.es discussing tool skills in 
individual .rl^^tsrccr^s ♦ u.nd sc-ace scnedul^ng does not see:^; to h*:^ a rvi^::r 
problem, t^<c■•^cr: one teacher f-c-lt i'ched-^^1 mc ro:j:ld b::- xr^provec. A portable 
.Z^eiiiian I^ad -cjrt oxj:st->* rut l:":tle u:::^-cd. 

rijn:e «s r^*:t^ ^.Vviil^dlc t::;r V?:-:ES -ur-'^vr rr::^ t.hcr:at.xcs . lanc-ace 0;rt£. scxenc^i , 
an-^ sc-cin.'il stciios^ Tr,-:- b*cge.tt < inclo con tr irs^^cor is science tir^e^ which 
:n fix»::d cy statute ir. tne .arro.;n.t r^f 3'-D'-6G -:;r..j;tes per day, and is availi^ibie 
:"or ■:;s;<£:S. Wor^ i:.- dor;':- or; c;:rtive ':2:^S cn^csllengc ir^rr. two to txr^es 
^ week: :r:c-:^t re ^p*^nder t ^-^/^.t •vno^-'n t:,.r^ ^^'^ livail^le for USMES* 

At present. ;JS^lS5 soer:^. to c-j ro^scnal^ly cons:..stent ^:Lth district pcliry 
■ ';if recto Schc~tl ""Z" r>oth .r. theory and .pract ic--^: - probleK-solvinc 

.1:: on^c: of forr:^ily-^ts:^te-'i dxstrict pedagogiccil . coals , CS:<ES correlat" •^ 
v^:?!! vi.t:h cth-^r ■rrurrl ru! r>.:^ tor : a l^a ar:d vith SAWV. a cur r:icclun:-coord ina tine 
prograr"^ f :.r -ricx^rnrc used m tho district. ''Back to B<£.-:ics"' ts strong in the 
•iistrict, 3nd. -^cccrc.'.c: tc tno crinci^ul, School "D" is ^ "Back to Basics^ 
.chc-Dl*'; ^h^'^■v^v■e^. the roc;-:^. ct structu:*'?-:; bas^.c :nstruct:.on in School ''D'^ is 
r*?'^dinq^ ^ir;C i:S^'3S us^fd to ccctplcir^ent the hit^hlv strcctured ^casic skills - 
activity wn:ch this ^rr:pnas:5 requires. l.x>;cw..sc* USJt^S :s v;,ewed civinc 
yc-f f Oct.- vv b.Ci^i-:" :5>; ... II :r:::,t r-;ct ;.cr: ^n Science.. 
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;eneroii* r^-^hut :::.n>; c-twet-r U3>:£3 teacher . ani ethers at School "D" are 



n:>t , >rrain!ed . ' :;i>:::cvr:tly . ncwev-::r, when it was nc:rcssa.ry tc transte 
te^acher^^ th-:r pr -nc;;.r;:-r:^l -^scd h . 5 iiscr-'jt.-.cr-.^iry tc-ers tc ret^iin all 'JSyjiS 
t-each^j^r::^-. There- ccr-c- anxiety on th-c- c^irt c: UEO-tES t-^achers thac othe: 
r-ay r*iri>ent tr.m:s. There -j^rer nc*-*>:::ver . nc- sicr:-s of any ^r-t-sen tn-.ent not associated 
vi^th^ rhis specific -n:;identv and everyone .seer"::> t-:. hcrce the principal 

:^:;^ppcrts 1:S:'1£S -e^chers and r*cr.~i:S:-!E3 te-iichc-rs tili:-:e. ^r^d that r.e ices not 
tr^:5>scr<^ teachers tc ySMES. Th^j-r^ h>s ^heer^ sc:tt:^ difficulty vich trcs- 

toci^ns .abc-u:t "rrtoss'" i^^-t the cr chirrs have not been serious-. 

Report in:; cc p.ixrer:tc r;inirv.i: , Tr. f .^ct, USXES vas ihlrcduced vith the 
££0£iS£ "tJisit i.t ^-^^ciS non-craded procrva:i^. In general > parents ^re ''•happy" 
vith USMZ;^. ^dectc effort li; ruicc tc keep parents infc:j;n^ed about real 
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prob?*,eri sclvinc — for ex^ple. a skit vas presented to the local PTA — but 
the effort is not a strong one/ and there seems tc be little contention 
c " antagonisrPi arrionc the School "D" parents. 

Altnough one non-L'SMES teacher was under the inpression that USMES had 
no effect on students, all other respondents seemed to agree that USMES- 
trained children ce." vork better in groups. One respondent claims to be 
ahle to tell ^^tlIc ren had been trained in USMES by their actions. 

No evidence had : .d rhat USMES affected standardized test scores, 

e-^ther favorably -orably, by comparison with other science curricu-. 

^ Although respondents at School "D" suggested USMES for use with both 
slower-th<an-average> and brighrer-than-average , students, the bulk of opinion 
would seen; to favor use virh the brighter/older students at School "D". 

Many of the teachers at School *'D" regard USMES as cor3 material — many, 
however, regard USMES as a supplerjent. In general, it would appear /that many 
teachers need to know r.ore about USMES- Learnirig would seem to be a littl ? 
haphazard for new USMES teachers, and r.any USMES teachers spoke of miscon- 
cep::-.:;ns they 'r}^^lc when chey began using the program. Many, however, intend 
to continue using the program now that they have come to understand it, and 
are of the opinion that "only USMES has real problem-solving," 

In general/ School D appears to be a good environment for the USMES 
program- One interesting future development planned by School D's principal 
is to h.ave "at least three teachers doing USMES at every grade level," and 
soGe unifying recordr-keeping procedure to facilitate students getting a full 
but balanced exposure to USMES over several years. Thus, some mechajiism 
would ir.s^'Jtre that a stiudent was not exposed to the same challenge twice, etc. 
This principal also believes -chat "slower children should do USMES/" and that 
they can benefit from it- 
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School '*E" 

School "E" is located in the mid-central portion of the United States. 
It is in a small city of about 50/000. The school itself is -set in an 
urban/suburban neighborhood, of middle to low-middle class socioeconomic 
status. The student population is about 80% white, 20% minorities- Total 
enrollment is 550. 

Teachers in School E frequently do several units at once. Among the 
units have been School Zoo, Growing Plants / Soft Drinks, Advertising, and * 
others. A Design Lab space is available at School E and is importcint to 
the USMES done there. Materials at the lab are kept up by the principal, 
i\nd the facility is described as "well supplied." One dLmprovement sought 
by several respondents was a full-time Design Lab manager. 

Aides, and the rout:^ne use of aides for USMES teachers, are central to 
the style of USMES teaching carried out at School "E". All teachers agreed 
on the importance of having aides / particularly for USMES ^ and even the 
wished-for Design Lab manager is conceived as an aide. 

Time employed for USMES is science time, math time, and social studies 
"res^earch time." Typical scheduling for USMES employs periods of rather in- 
tensive work — a "mini-course structure/'' with over 5 hours of USMES per week 
for several weeks, is apparently quite corrnon* Respondents are divided c\s to 
whether enough total time is available. 

. USMES Vias an important role in the school (almos't all teachers at the 
school do uSMES) ^nd is explicitly approved by the Boa. ^ of Education (t]ie 
^principal persuaded the board of the im.oortance of USMES) . Parents are 
familiar vith USMES through reports made to them by the school, through con-- 
ferences :*.n which some teachers report ori individual strengths and weak- 
nesses of each student, and through "scrcunging" efforl:s by students to 
secxire materials for construction. Parents are described as all having 
responded "positively to USMES," and have voliinteered to help. 

Relations between USMES teachers and others appear to be harmonious. 

Teachers are generally positive about the program ("will always use 
USMES") and believe that the USMES techniques may apply to any subject .if 
an aide is available . Teachers are eager to see new materials a i be up-to- 
date, and in general are strongly convinced that the custodian's cooperation 
and flexible support on the part of the principal are critical for successful 
USMES. At least in the past, some training has been carried out in district- 
held workshops, and on a one-to-one basis. 

In general, it would \ ^rar that School E presents a^ model of stable 
USMES ^plementation with string mutual support among teachers, principal, 
parents;, and the school board. The importance of aides, and the general 
flexibility of USMES use at School "E", are notable factors. 
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Sumaarv ' 

In Schools B, D, and E, USMES is used with considerable success, and 
USMES has a significant impact on the life of each school. In each ca^se, 
the local USMES implementation is tailored to lueet local needs arid resources^ 
but all would, in the words of our on-site investigator, "make excellent 
demonstration schools for USMES." , 

At. School A, USMES is being hindered by a generally high level of -con- 
flict and mutual suspicion among teache^rs, administrators, and parents. 
HowevejT/ goofi USMES is being taught, and -students at School A are particularly 
r^eptive to. taking initiative. Thus, the new principal of the school niay 
be cLble to evolve a model of USMES capable of responding 'productively . to 
these pressures without undergoing excessive distort Jon. 

In School C, USMES is in ^decline, probably because of worsening district 
climate and changing student population, which seem to have put pressure on 
students, teachers, and principal alike that discourage the use of USMES and, 
create an atmosphere of anxiety. However, the USMES that is being taught. is 
generally good USMES. 
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INTERPRETATIVE ISSUES 




USMES AND THE DESIGN LAB 



The use of USMES traditionally ^entails the use of tools and construc- 
tion facilities. The developers of USMES, by evolving the concept of a 
Design Lah, have sought to formulate a^standard strategy for efficiently 
providing such facilities as add to the breadth of ^ many USMES challenges. 
In this study; two empirical questions relating to Design Labs inevitably 
invite our attention. First, to what extent does the success of most school 
USMES programs depend on the accessibility and adequacy of such facilities? 
Second^ what sorts of Design Labs are most successful? 

Let us consider what sort^ -of,--facriiities are available ~a1r~Schoa is "A' • 
through E^ and how well they meet iocal- needs. At School A a portadDle cart . 
was used. Although th-: -e was some difference of opinion, respondents gener- 
ally felt that this fa lity was not adequate. The lack of a Design Lab 
space was cited as a handicap, and it was noted that teachers might "shy 
away from some units" because no satisfactory facilities were available. 

In School B, neither a portable cart nor a separate Design Lab space 
was provided. Tools were used a great deal, however, and the principal com- 
mented that a Design. Lab space was not needed because "the- whole building^ 
was used!!^or construction activities, and because students ea rned mo ney to 
purchase necessciry supplies. It i^ clear that Schoor~-B— takes a serious 
interest in facilitating construction activities (teachers are regularly 
instructed in proper tool use) and it appears that a great deal of success- 
ful construction takes place there; however, ^more than one respondent voided 
•the wish that a separate Design Lab space be made available. 

One suspects that USMES has such vitality at School B it will succeed no 
scatter what facilities are available. The success of construction activities 
at School B does not mean that the school's solution to the Design Lab prob- 
lem — no Design Lab at all — would be a generally satisfactory one. It should 
also be noted that construction activity at School B is not altogether fi- 
nancially unsupported: a $1,500 award from the district's Special Innova- 
tion Fund was employed to buy tools. 

. - y - * 
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Schools C, and E, have separate Design Lab spaces. T^e lab at 
School C is perhaps the- least satisfactory, since it is lo::ated in an unused 
shower room which most respondents found "too far" and "too isolated" for 
effective use* Complaints about the remoteness and isolation of this space 
should not JDe caken merely as complaints about inconvenience. At a school 
such. as School C where teachers aides are not habitually used to assist in 
USMES challenges, teachers wishing to use Design Lab spaces for construction 
must divide large classes, and supervise simultaneously students in the class- 
room and students i^n Design Lab spaces. Merely "keeping order" under such 
circumstances is difficult if. the spaces are far apart; adequate guidance 
and supervision becomes nearly impossible. The seriousness of this issue is 
borne out by the fact that one third grade teacher at School C had her stu- 
'^ents buy rather than construct cages for the School Zoo challenge.. It is 
interesting that the situation at School C is one in which teachers* aides 
would be of great use in mounting a successful USMES program, since the in- 
accessibility of Design Lab spaces would then pose fewer problems. However, 
there is little tendency at School C to think in terxas of aides. 

School D and School E have separate, heavily-used Desigji Lab spaces, both 
of which seem to be functioning -uite successfully.^ The lab at School D is 
well- funded by school and distr - (funding provides for acquisition of , 
materials and salary for a Desi^^ Lab manager), and is being used to 'capacity . 
Most respondents describe the space as "just adequate" or "rather small for a 
whole class, "and some respondents noted that Design Lab use could be "better 
scheduled." It would appear that it is the Design Lab manager, rather than 
the Design Lab tools or sp-ce, that is centrally important. There is a history 
of cooperation between Design Lab managers and individual teachers (for ex- 
ample, the manager comes into the classroom to help with tool-using skills) 
and the pj^esent interest of School D's principal is to secure not a better 
space-but a full-time Design Lab manager who is an elementary school teacher 
with full liaison to classrpom teachers. Thus, in sore measure, the adequacy 
of fiinding for tools and the presence of an active professional Design Lab 
manager compensate for tne marginal quality of Design Lab spaces available. 
A portable Design Lab cart, well-outfitted and provided by the principal to 
supplement existing facilities, has been unsuccessful. Everyone seems to 
agree that this cart has been little used, and the principal finds it a 
"disappointment." 

At School E, there is much less funding for the Design Lab, but apparently 
the space is" adequate^. Design Lab use, like .all other aspects of USMES at 
^chool E, is greatly facilitated by tV.e "flexible and extensive employment . 
of teachers' aides. Indeed, it is a full time. Design Lab aide that respondents 
from School E would like to see. The Design Lab at School E is perceived as 
a highly necessary facility, and the principal is concerned to maintain' Design 
Lab material supplies. Fortunately, most materials (apart from Tri-Wall) are'- 
donated. to the school. > 

Naturally, the information we have gathered on Schools A through E cannot 
serve as a basis for reliable general conclusions. However, the facts appear 
as follows! , 
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• Portable Design Labs (carts) do not seem to invite much use. 
The reader will recall that both Schools A and D have outfitted 
Design Lab carts, and that neither has been much used. It is 
interestdLng that minimal use seems to be the rule both for SchoL/1 A, 
where the local USMES implementation is laboring under serious dif- 
ficulties , and School D, where the program is much-used and generally 
respected. 

• Since a great deal of construction activity takes place at School 
this one instance demonstrates that, in an environment where USMES 
activity is both pervasive and intensive, construction can take 
place with no special facility. However, there is evidence that, 
in schools where emphasis on the USMES program is moderate or weak, 
teachers are sometimes deterred from construction activities if good 
Design LcLb facilities are not present and accessible. ' 

• The facility of School E is physically adequate, facilitated by 
aides, but not ;'.3Xticularly well funded. The facility of School D 
is very well funded but physically marginal. The facility of School C 
is physically inadeqr.£!te, riot particularly well ftinded, and not 
heavily-'Staf f ed. It is probably fair to say in the ^ost general terms 
that the lab of SchCHDl C is not adequate, but the labs of D and E- are, 
according to the reports of most respondents. This suggests an"' inter- 
esting hv'pothesis: . Merely to have a separate Design Lab space is not 
sufficient; however, if this space is* convenient /and large, or if 
funding exists for an active professional Design Lab manager, or_ if 
aides are readily available, the facility will /probably be successful. 

/' 

The second main question— to what extent does the success of an USMES 
implementation depend on the adequacy of its Desig/i Lab facilities — can only 
be answered in the most general terms here, but the answer seems to depend on 
the administrative role of the person asking the /question. From the principal* 
point of view, it would seem that a successful USMES .program can be fostered 
with' no Design Lab at all (as with School B) so' long as one^can use one*s 
"whole school" as a Design Lab. From the point o-: view of teachers, the pres- 
ence of satisfactory Design Lab facilities is/probably thought to be important 
for instituting a successful USMES implementation. Respondents from School A 
and C, where most USMES activity is initiated by individual teachers, made 
this very clear. 

There is the statistical evidence in Part A that, on the whole, USMES 
sessions were rated more "successful" when there were construction activities. 
However, that evidence did not indicate whether or. not Design Labs were used 
for the construction activity. 



Teacher's Aides 

'It is interesting to note that, in Schools A through D, teacher's aides 
played a small role in facilitating USMES activities, whereas in School E, 
aides were much used and held to be of the greatest importance. It is further 
interesting to note that, unlike certain universally-recognized desiderata 
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such as access to Design Lab space ^ the use of teacher's aides is not always 
felt to be important. Likewise, our intuitive feelings that the use of 
aides ought to be somowhat helpful is balanced by statistical findings, re- 
ported in Part I of tnis Gtuiy, which indicate not only that the presence of 
aides has j.o significant general beneficial effect (Page 6.1.14), but also 
that the presence of an aide does not even conduce to more construction 
activity taking place, on a session-by-session basis. 

Our tentative assessment of the matter is as follows. Based on the 
statistical data given in Part I of this report, ^ it would appear that the 
absence of teacher's aides does not "spoil," or materially hamper, units 
actually attempted; on the other hand, the School E respondents^ indicate 
that the absence of teacher's aides would have deterred them from attempting 
certain units. Thus, it would appear that, if teacher's aides have an overall 
importance to USMES programs, it is in encouraging teachers to attempt more 
units, rather than materially affecting the quality and success of units 
attempted. Furthermore, among the five schools studied, local conditions 
strongly influence the role of aides: 

• In School E, a separate Desian Lab space was available but not 
staffed by a full-time manager; principal cooperation made getting 
aides easy; and classes were large. Thus, the potential role of 
teacher's aides was extremely significant. 

^ In School A, with its portable Design Lab" cart, facilities for con- 
struction activity were poor, an'i there was no motive for physically 
dividing students during USMES sessions. Thus, aides were not used, 
and the need for them was not felt. 

• In School 3 "the whole building" was used for construction activities. 
Likewise, USMES activities were perceived as the foundation of, 
rather than a challenge to, order and discipline. No serious need 
-for aides was perceived. 

• School C is somewhat ^-^rplexing, since a remote but separate Design 
Lab facility did exist, and since discipline was a serious problem 
but, for some reason, no need for teacher's aides was felt. 

• In School D, the presence of a salaried and deeply involved- Design 
Lab manager, capable of bringing tools and expertise to the classroom, 
combined with the relatively small size and marginal physical character 
of separate Design Lab spaces, made the issue of dividing classes 
relatively noncritical. Kence, in School D, no particular emphasis 

on aides was in evidence. 
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The Scheduling of USMES Units 

USMES challenges, when conducted at Schools A through appear to have 
been held somewhat more fre<i,»ently than the 2.0 times per week cited as a 
mean frequency in Part I of this study. On the othe*- hand, sessions espe- 
cially Schools A, and appear to have been shorcer ' than the mean 61 
minute length reported in Part I- The schools would appear to fall in three 
main groups: 

• Schools B and D. In general, respondents said little about the 
exact amount of time used for USMES session. The implication was 
tiiat they were free to use time as available. 

• Schools A and C. Respondents gav:: -^t^ite detailed information about 
the number of minutes available for USMES session. In general, 
time periods cited were substantially shorter than the 61-minute 
mean length reported in Part I of this study (-enerally 20-50 
minutes) The implication was that teachers were expected to use 
specific time-5 ots which could be justified in terms of specific 
curriculum acti .ties. 

• School E. Although scheduling seems quite rigorous and ^ sssions 
(apparently) lim^te^^ in length, a "mini-course" technique of 
scheduling USMES challenges intensively (in excess of 5 hours per 
week) for a several week period was employed, perhaps to correct 
for the fragmentation involved in s: >rt USMES sessions. The 
results seemed quite good. 

Respondencs from School B and D (except for one School B respondent whose 
class had special activities one and one hali hours each day) reported that 
they had "enough time." Respondents elsewhere were divided^ perhaps more 
according to individual teachers* conceptions of USMES and classroom skills 
tlian according to actual scheduling opportunities. The principal of School C 
. spoke of time as a "big factor'' in scheduling USMES; by this she meant- she 
was concerned that USMES took too much time* 

Though this sentiment was not expressed by other respondents, it points 
to a problem which none of our schools could escape: namely, finding the 
time, sufficiently compact and sufficiently extensive, to support a good 
USMES implementation. External factors made this very easy m sope cases, 
very difficult in others. A natural procedure is to schedule USMES as math- 
emat'cs, science, language arts, or social studies, according to the nature ^ 
of the challenge being carried out. In mar:y instances, district-imposeo 
^constraints or community attitudes made these subjectf=: particularly resistant 
to discretionary change at the individual classroom level (or even at the 
school level). In general, however, no alternative strategies for scheduling 
were seen to exist. 

Schools B, D, and E are most successful in reiving ^icheduling problems. 
Evidently the principal of School 3 quietly treats USMES as Vcore" material 
from a curriculxm-planning point of view, while she points to the dramatic 
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and GXtr^^mely ^ vsitive effects of USMES at her school as a discipline- 
and morale-builder. In general, she proceeds with the approval of her 
district, but without positive district support. 

The TJSMES implementation at School D is carried on with more positive 
district invclvement, both in terms of funds and overt support. The 
principal of School D uses USIffiS as "core" curricul\am material, but ex- 
plicitly poses the rather freely-structured USMES experience in science 
and n\athcraatics as a complemenr to his very rigorous, highly-structi^red 
program in language arts. Under these conditions, he can quite accurately 
characterize School D as a "back-to-basic.<^ schools," giving him personal 
credibility in the eyes of conservative elements xn his community. 

At School £, scheduling problems are softened by the use of aides, a 
high degree of cooperation among faculty, and a high degree of "saturation" — 
most teachers are USMES teachers. The principal of School E is able to 
proceed without much concrete district support (at least in terms of fund- 
ing) , but has secured the approval of the Board of Education for his USMES 
activities. This approval, while it maiy not relax district curriculum 
guidelines, does make USMES "respectable," so that this principal is free 
to mount a very conspicuous USMES implementation,, with aides and flexible 
scheduling and overt administrative sponsorship. 

School A is an unusual case, -^ince district science objectives explic- 
itly recognize USy while community co-^flicts and parental pressures make 
it necessary to fir.i additional justification for zhe use of USMES as "core" 
curriculum* No?* stable arrangement nas been worked out, b*at the ne\% principal 
of School A has speculated hat a place might be found fc : "interdisciplinary 
study in the curriculum, if objectives could be identified and progress veri- 
fied by testing. 

In School C, little is done to "find time" for USMES at the school level 
but the School C principal does not prevent individual teachers from doing 
USMES when they ca:.- 

From the information collect^=^d on Schools A through E, it would appear 
that a number of avenues exist whereby resourceful principals who wish to 
use USMES can schedule the program. It is interesting to note, however, that 
none of the three most successful methods iused in Schools 3r C, and E) 
represent formal alterations to curriculum guideline-. Conversely, in the , 
one instance (School A) where district guidelines explicitely rapport USMES, 
formal endorsement s^oems to afford little real support. Apparently the best 
solution to the scheduling problem is different under different circumstances 
probably, also, there are situations in which USMES scheduling cannot reac"^. 
satisfactory levels until basic problems of trust, communication, and cocpaxa 
tion have been to some extent relieved. 

Where USMES scheduling is taking place uAder difficult circ^imstancGS , 
and where such difficulties take the form of stringent accountcibility and 
planning constraints, USMES teachers and r>rincipals frequently report that 
they are hampered by being unable to offer an advance account of precisely 
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how much exposure to which basic disciplines will be afforded by a par- 
ticular series of USMES class sessions. It is, of course, inherently the 
case for all real-problem-solving activities that the formal subject-matter 
to be "covered" in class sessions cannot be rigidly controlled, ana cannot 
therefore be infallibly predicted in advance • 

However, it is possible to estimate probable cimounts of basic skills 
exposure which may reasonably be expected for each hour of time devoted to 
a certain USMES unit, based on the 1043 Class Session Reports analyzed n 
Part I of this volume. One Table, showing such estimated value, is given 
below. The reader should be cautioned that certain radical simplifyir^q 
assumptions underlie the estimates tabulated. They are the following: 
(1) if any portion of a particular class session affords training in one 
of the basic skills areas s' own, such instruction is presumed to last 
throughout that class session; (2) for purposes of computation, the mean 
session-length is taken to be 60 rather than 61, minutes; (3) J.ISMES activ- 
ities are explicitly assumed to be integrative — that is, it is explicitly 
assumed that instruction in more thun one basic skills area can tu^<e place 
during a given time period. 
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Minutes of Easic SJtills Xni:truction Per Hour of USKES, 
by Selected Units (Integrative) 





?'«a thoitva t ^ cs 


Lonquaae 
ts 


Science 


Social 
Studi<*?> 


Nunber of 
Soj^nionc 


Bicycle Transportation 


45. 


53. 


S3. 


60. 


24 


Classrocra Design 


49. 


45. 


43. 


52. 


78 


Classroom Management 


45. 


33. 


15. 


15. 


8 


Consumer Research 


40. 


38. 


23. 


38. 


162 


Describing People 


36. 


47. 


19. 


55. 


38 


Independently 
Developed Unit 




39. 


19. 


49. 


32 


Designing for 
Huuutn Proportions 


9. 


1 7 . 


26, 


43-. 


7 


Dice Design 


• -J . 


48. 


12. 




10 


Getting There 


40. 


n 

\^ . 


S. 


32. 


15 


Growi:-:^ Plants; 


39. 


48. 


46. 




79 


Lunch Lines 


30. 


S4 . 


30. 


51. 


28 


Manuf ac tur i ng 


4 7 . 


32. 


27. 


38. 


164 


Xass Communicarionj 




30. 


0. 


3. 


8 


Mature Trails 


43. 


15. 




2. 


59 


Orientation 


-7^ 


47. 


11. 


51. 


42 


Play Area Design Use 


3 *• . 


60. 




51. 


14 


Protcctdj-ig Property 


^7 ^ 


37. 


26- 


26. 


37 


School Supplies 


• 


4 * . • 


26. 


0. 


16 


School Zoo 












Soft Dr:.n>c OeSicn 






36. 


36* 




Ways to Learn/Teach 


^- ^ . 


49 . 


-> n 




S6 


Weather rrcd/crions 




55. 


44. 


14 . 


22 



Totals/Other 



ERIC 



94 



Since many educators nay no:- wish/ a priori ^ t:o accept assunkption 
(3) above, another taiDuiatian is offered bo low in which the contrary assump- 
tion—that instruction in one basic skills area "blocks" instruction in 
another- *is employed. For these, purposes, where the total of mean basic 
skills instruction times for the four listed disciplines exceeds 50 nsinutes 
to the hour, all estimates have been proportion^ately reduced. The "blocking** 
assumption reflected in thy6 figures below rnay appear absurd to raany readers, 
but it has the advantage ^f generating a set of -conser^'ative" values,, which 
need not be explicitly justified in tGrr«^s of integration: 
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The reader is c^ucicned- t-hat Jx^t^^h T^bici; contain only estirxates^ based 
r^dic^i »x«pilfyi.r^z assur^ptxcrs* Beth arc subject to the chAllcn<;e that. 
s»AlX groups workljn^ on different ^apects of a orobler> »ay not cocounicate* 
and that basic sJci lis --exposure aCforded to one group may have no ef fect oa 
another • Lxkevise, the second Table, whxch xits.5urj<^s "blcckinq does .so ir. 
a sopevhat sxxpi^stic fashion., sir.ce it proportionately reduces oean values 
rather than in,spectinc: each -session fcr multiple basic sJcxlls exitries, and 
pr-oportio^Qtely reducmc jur^t those entries. 

. " . £ ^ , ■ 

_ rurthcrt>o£e f^-^xres xn both Tab! es arc absurd >^.. or.e_a^^^ 

that bisic t^killfi ir.iitrcction .ir, a reai-probiert-solving "curriculum takes place 
i.n dis-crece episodes, ^ilternatxnc with rather than inherent, in problem- solving 
active ty^ s^nce the r.ean r.ur±?er of basic skills bexng treated at any given 
tiSH? -ppears to be at i^iast 1. fcr ev'^r\- challenge in bot^h tables. Values 
»ore in line with thiij. assur-ptior. rucht be derived frocR the firs^ tabulatiojn 
giver: abcver by select rnc a^rbitrarily sc^se fraction of an hour^. assissiinc that, 
all i$kills-instr:>rct ion epistdcs ^i^ere of that parcicular duration, eind ir*vlt:i^ 
plying all -q^ja-ntitics in the tables by that nur:i>e.r* Unfortunately., this 
v^uld y:Leld r:xsieadtngly valued", since if ^-^ould, in tvim* entail the assus5p- 
tier, that only or.e "epx^.ode" • ^r. each o: the four basic skills area ^;:;cuid take 
place wit.hi-:i s sin.;lc vlu?-?: 5e'.>si.cnw ^^^^ 

All the ficxires ^v*.ven above reflect yean values only- In sorr^e USMES lies-^...^ 
sions, no basxc sk::ll3 instruction t^.kes place; Jin others several kinds nay 
ta^ke place. N'ever tholes 3 . these t..iculat ions of rreans r?ay be helpful for 
planning p'lzp*zs*2s. 



VSHES ar:c the local Sc^^^.c-ol strict ' 

The interaction c-ct^eer ::s:<£S the loc^l educational ''clir>ate** prevail- 

ing m the district to which the US>^2E:S s^chocl belongs takes ver^* different 
fortts arscnc the five cases studied. 

Sch^l A IS part cf a dist-r-ict djivided by profound conflicts; local atti* 
tudes tcvarcs L-SKTS are likew^ise deeply conflicted axd incon.sistent . On the 
one hand.. i:5>lES correlates ^"very well'" with stated district pedagogical cb- 
;ject.ives* and is specifically "-u^itten in" to the science objectivi.^ of the 
■district* Tndeedr di^;trict doc^^ents recogni::e USHZS explicitly and ciinutely 
(down to the i-ndividual unit level) as providi-nc activi.ty for instruct iori. in 
zz.L2i.^u p rocesses. Thus, "on paper*"' the district affords an ideal clirate • 
for USKES- It IS signif iciint* hovever. tnat thi$ app>arent endorser^ent of 
wSMES in district guidelines, and the extensive and excellent uSK£S v.*ork done 
in the past at Schcc-1 A;, reflects the influence "'of only cne of tvo deeply 
anragon^stic and opccsed croLips within the district. A fact vhich.. ironically, 
is "not" reflected in district pedacccical guicelir.es, is that cbnser***ative • 
forces vithin the di>.trict and comunity haee 'recently effected, sveecinc {jif 
not necessarily cere lusive: ch::rces, replacing ''progressive'^ perscn-nel where 
possible and it^partmc a srrcrn: "cac"';-trr-',basics"" er:phasis to di.strict policies 
and accountability prccediirc; . The principal of School A at the tin;e of these 
ch^inges wo-s replaced* and :jjr)cz:v.er :.ndivid;;al was brcucl:c iri, to "^brmc order" 
ar,d iDpleirjent new district erphasis on basic skills instruction. The rcsu-lt- 
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vnc sicuAtxon is i.ron.icX since this principal is hi.D5?elf qui.te syrapsthetic 
-to US>iES, thcu-gh ccnserv\vtive forces in the ^fiistrict are aenexally critical 
of is^uch progrons* This irony is ccu-npo-tindcc^^by yet one more reiaarkable f^^ict: 
this principal vants tc de^velop L'SMES as a /pzociran for cxfted students, 
vhcreas USMSS tiyachcr's rcrMainmc .^t Schc^r/ A perceive the prcxyrami as rrost 
effective for helpinq slower students* / 

Xatuitively one rxcjht irsacrine thay' a- district (such as School AVs :lis~ 

.^tria!i:L, .-:ji..v:t.i^ PAx.los.Qpi>ie.s. are. stroaa-y .xepr-^seri.':.e<3 z....,^.. 

sight operate 'in either of two quite ' gt'iffereat rsodes. Conceivably, if cp-- 
posing views couivl win proponent:^ -at 

on%'^iron»ent Triicht arise \r\ 'fhich cor¥>etir:q techniques (free 3Jid structurod^ 
inncv-ative and tradi ticn.al"'; would e^ict si-ie~by-side in a competitive rather 
than a preer^ptive conflict, Presurjably in that situation,, the best in tra-- 
dit:ior.al teachir-g as well as the b4st m innovative teachings vould be de^nanded 
of all participa-- . and USMES copld coexist viqorousiy vith other teachinc 
raethods- On the other hand, a si^tuation nticht arise in which factions com-- 
peted preerTrptiv^ely- — strugclxng through adininistrative t?>eans such as alterinc 
the fens of ac<;cuntabilitv prociksures ^ instituting directives and guidelines, 
or purgmc unccnccTiiai tcacher^r' and adr^.inistrators. . In cases ^where a st-ruccle 
takes tr. is fort?., if the result/is anytLhmi less than conplete victory' for one 
croup, one nichr expect ::oth groups (here;\. both conser\-ative and innovative") 
to be soc?.ewhat. thwarted by adyersarv' stratacens. 

rt v*ouIc appear t.hat Sc>6ol A finds itself in a situation larcely of the 
second kind. Thus, the future of :*SMES at this school is problematic/ and 
dryper.ds on the development ^^f a r^oce of USXSS which can satisfy minutely 
part :icular iced cumcul'un r'equirer.ents. conforr, to stringent accountability 
and Qrande--reportinc procesSiiros, and s'urvive periodic changes of faculty and 
princip,^' v^thout attention- 

' The relationship between i:s>:^S and school district. at School 5 :is, by 
cor^ariscn., ver>' sir.ple./ The district neither helps nor hinders USHES- This 
district is "innovative ;br. paper." but dedicates funds to procrams in basic 
skills i-nstruction. In/general* the ^'riethod*' of School B's prxncipal is to 
do wSMSS on her own authoritN- with school funds. Her great success in using 
USHES to build morale ^':rd discipline oit School allows her to proceed in 
this essentially neutril district wirhout being challenged: indeed, School B's 
success h^.vr'won it ocibasional fundincj. 

The district to which School C belongs has recently cone to place a very 
strong epphBsis on basic skills :Lnstruct ion, at least in its day-to-day 
policies. As is true in School A's district. USMES is still consistent with 
school systert, goals overtly set down, bur is currently discouraged by newly- 
i'^stituted logging" 'jj>.dVcontrols procedures, and interacts l^rnle with the 
1 -jTt of the curricu^lun. ' It. would appear rhat the district ..s distinctly 
ur.wongenial to USMES* vrh*>reas neither district or schc-ol principal has at- 
tempted to naxe experienced LSMES tearhers stop using USMES^ distirict poliaie^s. 
deter new teacners and have prevented Scnool C*s principal frcxni sup.corting 
ITSMES in any p-cs itive way. 
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school O's parent: disrrict suprNDrts; its CSHES proqriun. In our vacw, 
this is due not only to the fact that School D*s district inherently favors; 
real problen-sblvinc, but also to the fact that USXES at School D is part of 
a very successful overall prograir., in which t ichtly-^structured programs 
(for example* the l^nguacje arts prccran) as well as f reely-^structured pro- 
grams (for example, the US^ES prograin) play anportant roles. Thus, we fcel^ 
School D's principal offers his district a strong, ba ■ vnced "package'' of 
which USMES is an integral part. 

School E carries on its extensive USMES program without district funding, 

ciroiastances, US>tES can assurne a pror:,inent place in the school's cmrriculum, 
and a r?.ch school^wide adninistrative support system can be used to facilitate 
7SMES; furthemore, te: 'ier*s aides can be emplov'^d freely ie^nd in School 
they are so emtployed) . School board support was initially sought and secured 
by the personal efforti, of the present school principal • 

Obviously, the foregoing is too diverse to support many generalizations. 
However, it is probably safe to say that (1) district, support (and indeed/ 
district appro\^al) of real-oroblen-solvinc; is no longer '•automatic" even 
where forrrally specified district goals and polici-M.^^ would seem to xnake this 
inevitable; {2> on the other hand, district approvA"! can frequently, (though 
perhaps not always) be secured by a resourceful principal, even in districts 
not particularly disposed to real-problerr.-soivipg piogramsr if obvious bene-- 
fits are displayed (School 5) or a powerful, -"balanced" program^ incorporating 
structured and ncn-structur^&d activity, is offered (School D) • 

It is a stri:<ing fact that school districts must be continual ly^ motivated 
to support a program such as USMES- The probleris cf Schools A and C dramat- 
ically shew how rapidly even overt, forrtal dis*: t support of innovative 
programs can bo lost. 
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USMES AMD ITS EFFECTS 



It xnay be of some interest to review here our interview respondents* , 
coERments on the effects of USMES. 

USMES and the School Environment 

Where USMES is successfully implemented ^ it generally has a s^xong 

Effect on the atmosphere of its school. Sometimes this effect is difficult 
to describe in concrete terms, but in other instances specific results are 
apparent. Thus, a metric coloring cookbook developed at Schoo?. D through 
an USMES challenge received newspaper and radio pxiblicity for tself, for 
USMES r and for the school. Likewise, at School many practical improve- 
ments to the living environment have taken place as a direct result of USMES 
challenge activity. Respondents at the relatively •'successful" schools 
(B, D, and E) commented quite frequently on the social effects of the pro- 
gram, that USMES *'makes teachers feel better about this school," "gives 
children a sense of ownership," "controls the atmosphere of the school," 
" helps deal with a discipline problem which existed," etc. At scho*. ' s 
where USMES is relatively little used, or is used specifically on an, im*.- 
vidual basis by particular teachers (Schools A and C) USMES seems to have 
little effect on the school proper (though student effects may take placed . ^ 
In fact, principals of both these schools explicitly characterized USMES as 
having "little or no effect" on the school. 

Only one respondent felt that USMES had a negative effect on any school. 
A non-USMES teacher from one of the "successful" implementations, this re- 
spondent observed that "discipline seems to have^ fallen apcirt a bit" as a 
result of USMES use. Conceivably, this was a reference to the personal 
styles of local USMES teachers only, since the same respondent characterized 
USMES as a "good idea and a good program." 

USMES and Student Effects 

I ^ ..." 

Among the effects on students- noted by respondents were the following: 

• "USMES kids' inquiry skills are more defined than others. They 
* zero in on a topic . " 



"USMES helps kids follow directionsT 




"Kids' attack a problem better. They know what to do. 



ft 



"Socialization goes on between kids. 



tt 



"Slower kids come forward. 



tt 



"Kids with learning problems can become real leaders. 



It 
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- m "USMES gets kids to work well together." 

• ••Kids in USMES work better in groups." 

• "*Kids work in groups better after USMES; ^one'J can rell which 

{^students] used USMES before." 

This list is not complete, but represents the tone of respondents' replies 
Negative effects of USMES on students were not cited even by respondents 
who were skeptical about the value of USMES. 

Possible Effects on St£uidcirdi2ed Test Results 

There was no qxiantitative evidence known to any respondents displaying 
a significant effect, positive or negative, of USMES on stajidardized test 
scores. The im pression of some respondents seemed to be that USMES had im- 
proved tests scores. Some of the comments were Sis follows ^ 

• " ^Teachersl believed kids did better on Iowa tests." 

m "Math scores' are up: "[teacher believes^ USMES helped |[test scoresj 

• " [^Teacher 1 feels that USMES would improve reasoning and help on 
tests." 

• "Class is improving in language arts and in basic mathematics • " 

• "USMES seems to have no effect on standardized tests." 
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SUMMARY 



The interpretive findings of this section were roughly as follows: 

• Adequate Design Lab space. Design Lab tools » an active Design 
Lab manager, and readily availed^le help from aides are all 
important to the development of a strong USMES implementation. 
However, no one of these items is, in itself, essential for 
success. There is some evidence that, within this group, strength 
in one area can compensate for weakness in another. 

• Finding time to schedule USMES activities is a matter of major 
importance in developing a successful USMES implementation. In 
general, school district curriculum guidelines, whether favorable 
to real problem solving or not, have little eflect on scheduling 
problems. More important factors are: school board support for 
USMES; and success on the part of the principal in integrating 
USMES with the total school program, 

• USMES is more successful in some types of districts than in others. 
Among the less important factors seemed to be: district ciirriculum 
guidelines and other statements of educational philosophy "on paper, 
concerning the importance of real problem solving; grade reporting 
forms (how "naturally" they -permit USMES reporting). Among the 
more important factors are: current "climate" of educational philo- 
sophy in the district (positive or negative towards real problem 
solving) ; extent to which the educational, activity of the district 
is implemented through gre- reporting accountability procedures 
(USMES is relatively hard to report on before it happens) . 

District financial support is very helpful in some cases ^ but other 
successful implementations do without it, 

USMES seems to thrive in a "back-to-basics" environment if it is 
viewed as part of a basic-skills-oriented curriculum, 

• Both student effects of USMEi^ and general effects on the schools 
seem to be positive in the more successful implementations studied. 
In the less successful implementations , student effects are positive 
and school effects are negligible. No respondents interviewed in 
this study had attempted to test the significance of school or 
student effects by quantitative means. 
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SPECULATIVE ISSUES 



USMES AND PARENTS 



Parents' response to USMES appeared to be of two types- Parents gen- 
erally satisfied with their children's education were, at worst, contelnit 
with USMES, and, at best, inclined to s-ingle out USMES for praise; parents 
generally dissatisfied about their children's education showed mixed fe- 
actions,. but sometimes singled out USMES for criticism. This division . 
(roughly between Schools B» D, and E on the one hand, and Schools A and E 
on the other) is not. perhaps, surprising, since USMES readily lends itself 
to praise ("real-problem-solving, not artificial problem-solving") or cen- ^ 
sure ("letting children drift, as opposed to teaching them something"). 

Let us review parental reactions to USMES in the five-school study. The 
parents of students at School A are as vocal r and as divided^ about USMES 
as they, are cJbout everything else. Some parents are charmed by their chil- 
dren's enthusiasm for USMES. In many instances r however / parents are dis- 
satisfied, and they do not see real-problem-solving as a "high-priority" 
ingredient in their chil<iren's education. Furthermore^ pajrents at School A 
seem to want continuing evidence of basic skills advancement for their chil*- 
dren — something which can be best provided " rough a program which provides 
for individuals rather than group, work^ and daily homework assignments. 

Parents at school A reacted negatively when they saw a play written and 
produced by their children as part of an USMES challenge. Apparently they 
felt the play was "amateurish." Respondents who tried to account for this 
reaction suggested that parents were unaware this play was entirely the work 
of their children, and speculated that, had the play been properly introduced 
and its education value expounded on, no negative reaction would have been 
forthcoming. We are inclined to take the matter a bit more seriously. 

It seems to us that parents' reactions here may reflect a rather general 
objection, motivated by strong "commonsense" arguments,- which can be levelled 
against USMES in environments such as School A. Children^ it might be argued, 
learn from their environment; and when. there exists an obvious discrepancy 
between the perceptions of children and the perceptions of older r presumably 
more enlightened, members of their culture on how something should be done 
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(in this dase, for example*, smr^mtr, ? iv^^^ nh/- n^tudor^t plAy ''^ms- 
t.«urish*^)r it isj part of any i*,itural Irt/irrA.nq pror;pr5<. for ch^K^r^^j-n r.o !><^ 
raade aware of tho dlscr^«p^n<r/, no thoy crin maV.^*» procr"^*i tcrward Ifiarninq 
cultural norms. Tlxxin, for ox^impl':, nfudl^^'nt*? b'^nt ir^/jirn to produce ^oo4 
olays by producinrr bent pL:*yr; pO!i:^»i blf?, f«ni iqhtf'Tif^d r>y the cri t:iclf5W 

of adults, 

•^Countor-argumonr-n are oar;i.Iy found" that ie/irnirig through rfjal^-oroblem-- 
Goiving' is deeper, better motivaffvi, more Inteqrat Ive , ie^ia aliritn^^ted, more 
permanent r etc. — and in ?;r>me ^schooln they ar^* b'.jrnf out with 
dramatic clarity. However, the /:ippl icabi I ity of these argtjment?;, and the 
clarity with which student response rihr^ws them to be true, varies from f^chool 
to school. In the case of School A, -:uch counter-argument may need to be 
pre,<*ented vertally, and with some subtlety, Thi.?i, of course, goes ^ome--riri.i t 
beyond merely informing pr^rentr, about USMKS ^?ctivi tier^ , 

A survey taken among School A parents of one clar.s .show that ^0>. b<:?iieve 
US^5ES CO be v<aluablo and xO%, hy>lieve it to be "a wa<;te of time." 

The' situation at School B ir; simpler. Parents trufit the school, and, 
furthermore, see the results of U3MES everywhere. In general, they are not 
involved directly with iJSy.KS , but they are wholly satisfied with it. Some 
parents at School B have actively requested that their childre;* be placed in 
USMES classes. 

School C parents are more disposed to participate actively In USMES — 
for example, parents have volunteered to staff the USf-^ES Design Lab. On the 
other hand, parental attitudes toward USMES are divided. Some parents are 
pleased, but some have fej/t their children were in ''too many USMES units-" In 
general, it is our belief that negative parental response is a minor problem 
at School C, by comparison with thoso arising from di5;trict influence, staffs 
and changes m student population. 

School D. It is interesting that, while parencs at Schools A and C are 
to some extent disturbed at the scantiness of individual grading and/Progress- 
checking under USMES, parents at School D are delighted with USMES, having 
been promised that USMES would be a special non*graded program. The contrast 
in parental expectations and psychology is, dramatic. 

At Schiool E, parents are plea=;ed and satisfied with USMES. USMES is 
merely explained, rather than justified, to the local ?TA, and US:<ES is fret- 
quently reported on ir grad ng (under appropriate areas) and in conferences. 
Parents are indirectly but repeatedly involved in USMES t^irough their children's 
material-scrounging activities. It would appear that VSMES^ with explicit 
approval from the local Board of Education, is treated quite matter-of- factly 
as a regular part of the curriculum of School E. 

In general, it is cl^-ar that parental attitudes toward USMES vary enor- 
mously. Some of the causal variables would seem to be: 

• The degree to whicn parents trust their children's schools 
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• J^arentai* pmrnonAl t*^*fiin^n nxynt qtra^f^A v^rn*j% non-^qt^d^ inctivity 

• l?«r#nt.3* <2 i upoa It ion to.r>*^co*!w .-ictiv'r/ l^-r/oiviKi in JJSHES 

•* 

It clear th^t, *jinl^««s th^^s'^ f.«*ctorrs t4ti»^^n Int/o ^cco^jnt, no efff*c- 
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Ati iwrt^remely important f^^cr^.r i.n trr,*? hi::icc*?<**!^ of 4kny jawpl^aaentJ*-' 

<i#h4t t^ch#!rris ;n^/oXve<2 in t.h^^r prc^ro^c ^cr.'^ally b«fli^/e USHES be, '^^"''•^^ 
thi© sam ocnjid of ^:>,.^y curric^jl-^. proqrws, th^ concepts onderl/if-q 

^.TSKTS iir^ iririr-^^ r -» - ■ 7 ^^i>♦^y^^^- ^r^^ fiis'A^^^f.HL:^*:^^^ OAB.i,!/ !ua>.a place.. 



rjSKSS "^Missul^t^s t^l.ir'^ .5 '.ci "br^^-^Kri up th«r roiirine. So<»« in for*- 
rsAr4t.s ^^'ievecS -^SKES ch^^fly .it'?. 4 forw of ^ctlvitv which ireli^jved 
tensions a.nd «fford*sr3 r>o?r.'^ f-sc^pe from structar«<S aspect n of rhe 
^i«jc^t.ton-»i env'ironrr^fr.t.- Sach InforsiAnts pr^sti^^ USf^ES/ but app-ar- 
ently dii<i net re'^-s.rd ari priswary e^uc^itional activity* Pother ^ 
they O r,c reqar*^ :..t. as ar. ^5t:rnosp^<i'7.'e'^irrprovin<j progran* one 

•#rhich r.„i,'7.:-;t able cr^vite >xr. ^rt tsK^spr-ere condussive to le^rriinq 
tt^o^^qh act.;.v urv7 /ftn rj r-^ tidot*? to constrants ir. the -school '>r*v:ron- 
.T-erit, 

USKES rurn..^ ov<?r cjm^:-.:'jr: ^:i*.'cx^>^t>n^w to cr^aliren. Or.<a inforr-eint 

i i<?v^.*<:i tr^a* the 'J ist in9uisr>zr.c f^^raiture of U^>^^ES was xts *t\ir.ni.oo 
over carrlcul?in df^cisiors to chit l^reru * Th^oagh this respon<:«nt 
neither praised r-or crxt tciji^e'l 'JSM£S so ux«derstx>od, it -is easy to 
Jjs-aglni? ---t^^t forr: praise or criticisra -flight t^e. One cslght praise- 
such .a prograr; or. pr^ychoiocioa I gro^-in^G^ speculating that children 
woulfi i>e T/::.tivate^ vo follow a. cumcult^rr s^i^ct^ by theaBelvet . 
Cr.iticiH:tB ^-^ould ix: ^r. temr. of children' i^^crance concerning t.t^^ir 

USf<E3 is r^vmc children collect d-it^- So©e inforr^itriS ir.<ij;c^te<i 
that the '•cnicf difference vath USMES" i^y in thc^ f^ct ti"*at "chi il<ir '.-n 
collect data"^ for therr-^elves- 

rjSMSS offers indi v;:du^ liz^d ^riSt ruction « One of the perspcjctives 
on enco^jntercd .aronc respondents was th^t -.t prcr/lded '^indivad- 

^oalizatron. " Thx/^ -vas gr-ner^lly oitec as a positive: featur<: of the 
progr^ir- 

';SXES 5kctr> ar> a :i:upp:er^'ntar v educational «2tctivity* ^^any respondents 
cxted the:.r own or others' views to thf? effect that USXES was >i 
-supplerrent-ary'* educationa: ac-t:.v;,ty. In general, the s^^n^c of this 
observation was that CSMZS is suxtaiile for ex«rciSin^. bist not in- 
producing; "corc'^ r^terial- The principal of one of the sost suc- 
cessful scnools ^itociec esti^r^ted o>';^t h^lf of that scr.4>oI's t^£.:i:::hcrc 
regarded US.HES prir-ar-y "core" :.nstruction* half as ettpp ienent^ry- 

^;s>i£S IS peripner^jl ed-^cational .activity • Soc5<; respondents have note 
that they "can't relate US?^S to acre irsportAnt things ^ like Ianc..a;^e 
or reading." ?restjr:ably the^ felt t^hat teaches scr^ethmg, but 

does not deal at all with i>xsic skills and concepts. Ic is not sur-- 
prising that tnese respondents were non-USH2:£ teachers- 
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• tSSIttS. ent^.ii,^ -ifti->S:erit ^utc-r^otr/. :-,-.js^r of r'--;pron<5,«?'n.t..?^ i^^m, ■"-'r 
t«Cton. "Ditt^t^rr.K re»pcr^^'n.t.r* «;4y n^-/^- vl^erwifi?^ K't-.in 'spirit* ^if- 

T^''^.'.:*^"^**.^.^.^^^ . .,::.-*iiecT , ,;p?d!:r.f::r^,.^ 

tJ«enta, tbo*a^h in iscrn^ c^,'ji*?s they J>> * <>v*;r<{ vSKES to be si?!^i-e vrtt-h a 

"xw <fAcn !5lcht. fSffcct. '.S?^ ...r tr.^ cLd^ssrOOT. 

Tbc-^ vi«^*r vr<;ch v:s -.^^r":- '^£*<L*:i' c-r -.'?'51y as 3 corrective, or ar^tldc^^rr t:^- exces- 
^ivcr ^'sriiruotur^i" ^r; >^ nc^^ool ,ncr rrl'jl^^te t.f7^- '::S'K£S prefect devifl- 

op^rs* but iz ^C'u:ld ^^^rtly cc-r.t Lrr^fi by cr^^ eff «criv^er;'es-s. of 

3^-;cc^^ssf ul t;SXE.I jiT^.. ^r. " :'>:;::i-eri,:r.c ^^^p" partic^jl^r scbool!: or te.ftC"ners 

For example, ore ■ of l.'S-l^'lEo School v-^s to furcrion -^s * 

countJRr poise, ocxrp: r r.^;r..l^.-str'^-;ct.ar'C<: I^nouage arts prcqr^^ It Is 
only in. st:^.e of i^s ^,jrp: t^or.ir. t:'..iit t-r.i^ ^ne-w- ri^iole^dxnq. The notion of 
an '■"ar.t.i^iote" % -r. • ''l-co^t ^S^^S r^y be effective Ir ro/xil "*qviAJ3ti.ties* ar*d 

t±;*3;t It r^ay o<?- p-:5rtiC'^ - rly "i^-lpf;^^. xr. a teo?-rr. difficult sit -priori pcrceivod 
studer.ts an "b^ir.g c -'^s^r ruot "^^r: forturatJ^ly* the very opposite s-e^-S 

t-o bfr tru-"-^- ' '-"tS ^^'^er^s r*.':sr:;^'sr to do, a,t::i I*>.3st -r-oce^sfx-;.! , in <5t tersc# over- 
ffltr^^ct--; .'. '■c--;r.<-^r;,t, a..od rel^itively le^s efficient whet. doo<s iri frequently. 

?iot: or.:y ;> r .:. ... o^j 11 y -iif i or ""vi-driir. i rtf-r " r<:r<5l problies^-BOlvIr.c Ir. 

33aall ^:ose':i.. rt...,^lly irpos^ijslc to deve lop trc f ull ;.*:':cl lcct:;al dcpor; 

of an --.i ^' a ihort t.,r^^. 



T>^«^ VI --r.atr '^S'-^T^S * oh^Idr^^r. " T.crr:,*^':: tr.c*r or-rr. c:-;m.culur:^ -c* 
corT*iot exoct"- frr .v:p<rtts of :ietn3^i,; v^h-:. it e^3y to sec r^w suo-^^ a viev- 
sight hA-y^ < If ir, > co'.r^e of an i:c.*<rs tn-allencc-* iizi^^nzs arc p^jr- 



In zhe lon<j run^ tn^;^' "dctemrf: tneir ow'- ourri C'U I ur? , r^ay ^ri^^^ Sti] 
vhjxtever xigr." 'rx- :.>.e r.r: vantao-::^. or d;, ^^tdvantacri-'r;^' cf pro-cr.^^ vhich did 
allow cnildren to specify tne^^r ow-^ c-mrul-jr::. it app-e<iro ti^at L-S^d-S doeif. 
not: rather, *curriCTj;2-urT** withrt {i oha-llcnce lo deter=?ir*<»i by the ne^ds of 
rh^t challenge. Of cours-e students nave freedor to assesa wbat obese needs 
are./ but assessing such n<>>ds is f^r fror: ti£i>~lr.g ^n jr.a-sidec crsjoice.. 
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of r «f ^ i I tj^o- «. v n-q . 

5;;^rocl<»i?:^ of .^t^*^;^-*^ is?:: ^jsrzs c*..5^^^'-i ^.r^r^u-^^ it^:;. r;.-^i*^^jj!ral ftr^^^^nt iee4«:r$. 
Tts^x*^ ^'.tz of r>^c>9^. ; r; -.f ^.-ir-'.^'^^*-.* ■rs-^^'^.o^.c-rr/ :v*'-r'^i,f^^ ^'^.n C-p^oofttic *r«MCo^- 

tsiqht -^if. of tx-^'X', irpC'Tt/^sr-t pj^^l^f * -^'-^ gri^i^;;'- real probl«5^*t!iolvlf;c;' 
sr^-.^n.i.:^'?!'^ for r <m * r c r.- ^t'; - 1.. v;. -^r, : c ', t- c z^^ 9 ; ^ ^^^crt^r* T r e ^ - ri^ct 

r<^rspcr.de.**.t.^s i -p'rct^^ti^y r<:f .;-cct:c:- % reco??" ^f t.n^ w:iy U2KES .-.si- dif-- 

ferer^t fr-^iic. tr.ad,;. ticr::.^ * v>:;-">:---I-v:ia *r'"-v*:rvc-*';.or. jLr; c^?^t>ie of reis^pcnd- 

f'i.c-.:^t:.*5:e .>ttrer:::-t ra::^'/ ' r^^rt:^' *;SKE:3 ctner currl-cul-jz: _pxo9r2:*r:5 

^C'TXvI; t f - -C- * - ^ r f 1- '/ r . % ■j.*'. 1 c ^3 . s ^12 * f * 1 u I f i 1 1 * r.c tJite C3 s-c 

C f ^.^^f y t.r d-i v:, ^ t c r, cr T'^. -it t ^ ^ - j * ^ix r^-*'' '-^'n C' vi trS^'CHS ^ t^hJL b 1 * gh* 
C^nrvc- cifford ir.^' r;;ry,; ^ill-C'-^ ".^Zy^S r-o ac^'ire'Iop itr: f-.>.ll depth ir. 'CrKTr-^ t 

r^^dT-.- 2^ t lofi r^c^w^.'f'-'c r ^ *■ • tii; t * "-i z-^"^-^-^ * Urw.>^S re>3 .1- 1 y can nc^ t car^/ t.hc 
i5tj.rd*^ r-. f CO f "^^^ ; *: c • r ^ T » ■:^-r-.,:ii , d<* c ■ ^Izt. z: :^ r. 'J.'^>^E3' r'-ii t t:r ct; i-vc f e-s t: -ltc s 
^a; ^ tjuppltvr^ertory^ r irr --.lur . -^rr\r .t t:-;.,r, ^Jiy iz. iallr. far --cr-^ 

it.ri- pct-e't t .r-^.^i I :.r-t:^ c"; - 

rh:e -cri,*-;^ t-r:,.-5r per ■:.^.r*^z:^ ^ ^jd..C3 1 iC-;^i activity tr,- t^-^iichcr-^ 
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se«». to agreo. that CSJSS isT a a<ssai:dir.g^ assbiraoijs^ a^d tisse- ■ 

peripheral Mr eriai orHy* it vould 
; -.be^ i^ rfee ^»wiblc of isi^lewsntLi.nc? ito • 

*'philcsoj&y* It: has beco5» 
c^Lear, i^^^^^ course of sssainy interviews -for zhis otfcer st:t?dies# thar 

conceptions of USHSS-r e^cfe present: is:^;?ai:5r 

'^.:.''a5oi3de^ receive oatvard expression- in very ' slT^ilcir iRiys^ Csr l^i© one haj>d ' 
^^^.^^^^ jefg?ecitilly ex?erie?iced CSKSS teachers^ Jtfiv^ cooe to view 

tJSjieS as a Sucb ccascnrs .as ^'che techniques s&iy be applied 

-2feay is ^i^Iable.^ "^USHES is a vay.of life^** reflec-^ this 

,: *^tti«ide. Osi rhe other ba.;^/r^.y respo:?des^t£' seeis tcvregard US?!ES as a - 
' "spirit* {pcrfeaps a cooperative, or r«5n-asrl^critarian spirit) of reaching,^ 
ictff are'iJ^cl;Ued vicv CSJSES ch^^llepges a?«2 ^saterials nercly as Mtteriai 
" J^^r^le toT esJ»dying such a ^spirit*'' These resporsdenrs oay that tJ:ey 
* -have •always done vS>SS vi>:>5aat: ^no*?ing iz^"^ or that it is possible to use 
• all curriaii«s ratcrials »-i.r; this '^spirit."' 

Shese t«c vievg are frequently e^cpressed wirh tersir^o^ogy reversed tscoe- 
one say^ "^philbsciphy^ vrth they i?eart "spirit'')^ and are oatwardly similar 
iis that, they both er/tail 'sccse notion o£ exter:dinc USKES beyond the set of 
'/ Pt&lished cs^Es 'chaliepnes/ Kcr-*ever. those vc refer to as the "'philosophy'^ - 
groi^ feel tJSK=S. ^ exte.ndec ro nev suh^^t areas ^ and the spirit group 
y' obeliev-e CSXSS pin be ^itplied zo ether Cust:ally all other) ti*pes of fitUy- 

developed corricuitOT c:^atteriais* in general i» the developers of ISKSS affirm 

■ the'viftitfs of th^ ""philosophy^ group,. Hcvever^ they doiibt that tSMES ca^i be 
Jsade tcJ tserge vith other sorts of ' ejrriculi» :saterials# . «s the ^spirit'' grcip 
^iu-taiaso "There seess to be s«e. evidence corsfirr:i^<? this*feelit>5^ since 

; . "*5essb^rs ■ of the -spirit" -^ros;? often find pcbiishGd challenges *too difficult. 

' *.2t seesss probably th^t these rcspchdenti' concepticr- of SSKss is^i^ca^Iete 
. ' c i«i" .scsse essehtiai vay* and thi^:: this preve.^t^ thess fic55 doitic pxer^axcd chal- 
lieges effectively. 

. The viev- that USKES jis a "philosophy" vould appear to be suhstaatially ^ 
i Correct. Hc^wr^ it hj^s rsisle^dincr inplicattcr^s* particu.larly for those v!ho 
^ .-^'-^are jxist becocriino £^?:ulia.r with the progra?^* Thus,- ^' "philosophy** ■ tdght seeo 
^ to be soC5e'thi?:^g vh^Lch can be ccrsr^nicato^ abstractiv e independent of .parties:- 

1% ctirric-ul'jrj s>ter.iai£. This does ^t sees? to. be true of tJS?SS> ^:^3J^y 
. re^porsdenta'' Vle^^ o- tnc ts?^ "spirit^ t::3.He pair.fally ciear> Li^^ewi^e. s 
^philospphy^ ^^ght seerj to oe ir^epe^r^cnt .^n Practice frcs any particular 

■ ^ curricuics r?aterials; tri^^t is* it ?ucht see:» that, a ■ '^challer.cc'^ cotiid be de- 
' veloped for ar>y real prcblesi. This, is, o^ coc^rse'^ an er-pirical ratter ^ but 

r - the asstfl5pti-;>n is probably fals*?<. Not all situatic^is lead to challenges vith 
the characteristics' t>at j?a?ce rhcr val*^ai>ie experiences in the prcble::?. 
^ solvift5 process* ^ " ^ 

■ }fcst,respori^nts* held accurate pexrtia'l vicvs on ti^.e essential mature of 
the IISJSSS. orcgr^s? » This cer-eral -tc ^er.cy isy .perhaps jf snerely a reali^aticr^ • 
of a r3ij«fal ht»a:a desire to "^pir^u dc^TV^ the essential ir,credierJt of USJSS 
t^ach.>5^ the ^iterig n tc- deterc^vine,. in a civer? C:5^se^/*?hether USHES vas ■bei^i9 
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-dene" or nee. • Ic vouid ^opo^, bowivcr. thac t:S?<ES is noz a procedure 
'deliait«5 by, a criterion (or criteria^ , but a hasan Interactivti bheijossenon 
«ihiLch can be expccti*d to .©rcur" berveen students aiid teachers'/'provided chat 
aoflt of a iet o£ critical requireuests is satisfied. All five of the escist- 
ii.^ CSEKSS .i=ipl«Eentaticr.S-^-Jdied, cotiid, in our o?i-nior. be stabst-arstially 
stresgt^eaed. if all teachers ^co^ii be led to adopt this vie^. . 
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TSACgSKS* QglNIffi^S C0NC£SS!2nC CSiSS 



«hiic it is, of course. ir:poasiblo to properly represent the full range 
of teachers' opinions concj&rning US.MES^ or even full range of stw^ 
opinions encountered in the int^rrvievs of this study? iK>^ver^ it is probably 
"oseful- to report, and cccaent on rvc::?^ of these. 

ISMES and Basic Skills ^ V , 

A wide range of opinion cc.':;cerr.ing t^MES and fc^ssic skills instruction- 
exists ano&g the respondents* Scne respondents felt SSKES bad nothing to do 
with '*.core* subject: ssatter^ such as reading other basic skills? sooe^felt 
tISXSS was properly ••a reinfcrceraent and utilization of basic skills^ not ini- 
tiator of basic skills; scc^e saw ust-G^S as a significant integrating device ^ 
for presenting and exercising basic skills in centrally iaportant cxarriculu»' 
areas such as satherr^ tics, srrience^ l^wngiia^^e arts, ai^ social studies. Siis 
range of opinion not only reflects, bur also determnes, a corresponding v 
ranee of tS^ES practice* It is easy t;^ see. how this happens, since a teac^«r 
vho^believes in^USMSS is psriphiitr^l v£ll. necessarily v feel- not at liberty to 
give it truch t^jre^ not to rely oi* it for the exposition of basic skills ;23a- 
terials. 

SJaturaily USHES is^valued sos>e schccl,s for purposes other than basic 
skills instruction— for'^ exar?pie, at School B, a great deal of essphasis is 
placed on USKES as a ^^urce cf !Mtiv=3tvxon* cjiscipline* and aorale 'asong staff 
and students, Hc\*'^ver, even in such instances^ it is not possible to devote 
large amounts of tir.e to the progran unless rne trusts it {as does the...prin- : 
cipal of School B} to deliver "core^ subject instruction as veil' as socializ-^ 
ing" effects. ^ . - ■ 

Correlation of vS.'^ With Tracitionally-Sesignated Subject Matter ^ 

It is the i^inion of r?ost respondents that correlations between US>E!S 
activities and tradit,ior:aily--designated stsbject areas could be detailed and 
justified. Several respondents felt that an account of such correlations 
vouie be useful to- tnsn m tiany ways. One already-existing docuaentf the 
USHSS Cirriculur* Ccrrel^.tion Guide/* is the prograr. developers* attetJpt to 
describe subject'-area ccrrelatiori for USMSS units. Of course^ it, is the 
nature of such a' "•guide^ that it is the possible treatment of- subject-area 
siaterial in connection with particular challenges, 'rather than assured treat- 
sent r which is tabulated Thus, such a guide cannot help teachers or adsiinis 
trators to sijbstantiat^^ curriculum 'correlations to skeptical parents or 
administrators. . . 

Part i of this study atter^ts to n:ake (and sui^^tantiare} certain very 
general claisas concerning frequency-of-treatstent for currioilua tsaterials— 
claias expressed in terras of the general --subjects** :<atJvasatics, science. . ^ 
language arts* and social studies. 



being incorpo«tted in the USMES Guide! I I 



Heal Problea^-SoIviiiQ As a Leamir.g Accivir y 



C^inion asong respondents was divided on the subjecz of whetber group- ^ 
strucimred real probleia-solving ±s, Isy its r^ature^ ari education activity 4, 
or whether substantial suppler::entary activity is required^ to make it so* 
Most felt it was educatioiial_ir- its ver\^ nature, but sone fe^ed that: srudents 
sight •^start snaking t^hings and stop learning," or felt that, to profit fro© 
real problem-solving activity, srudents needed to '"see an. end result at ah 
early stage. Tnis latter view vas chief Iv prevalent aiaong inexperienced 
CSKES teachers or ncn-US>iES teachers^ but seeded to represent an "outside*\ 
.view. 

Student Involvement ■ ' • 

The power of US>SS to engage and' involve students of all types seesjcd to 
be its rx>st-?raised attribute. However, in sosae instances (chiefly at School C) 
student involvesjent was less intense- In that school; students were scrsetiines 
•"bored" by.USMSS and it was observ^ec that students who were not already leaders 
frequent ly did not beccrte involved. 

Chaos . * 

It i:5 ■•alr:o5t inevitable that sone teachers, particularly those who have . 

not seen ;;SMES ''up ciose'^'or perhaps have not seen it at all, r:ay fear USMES 
as a source of chaos. Thus, even at successful ns>ES schools such ^Ss School 3, 
ve found a respondent who "doesn't want to have any part in having kids ran up\ 
the wall,'* This point-of-view, which sees USMSS as sociewhat anarchic^ is aasy . 
to understands since USMES looks and sounds less orderly than traditional in- 
struction^ and is organized in a way which is comparatively ^d iff icult. to ex- 
plain tc a casual inquirer. 

Many experienced 'JS>^ZS teachers feel that US>SS is quite orderly^ and seen 
to be thoroughly ''addjLCtec*'' to using it with, their classes. Interestingly 
enough* the. existence of such "'addicts.'' who sees: to derive a per*sonal sense 
of effectiveness and adequacy through conducting USHSS challenges # is an in- , 
direct indication that real probl en-solving is subtly but pervasively struc- 
tured> and that skilled US>SS teachers derive, satisfaction frcxn being in 
control of what is taking place,.. Their rview was borne out by classrooni inter- 
action studies (Boston University, 1973-74 USMES Study) which showed that 
US>ES student corrzr.ents were. less often randcnily or destructively directed, 

USMES Materials 

* 

in general^ respondents seen to have a high opinion of USKES naterials. 
(specifically U3ME3 Unit Books}- Occasional cossnents to the effect. thb.^ there 
were "too few" units ^ and expressions of^- interest on the par^ of experienced 
teachers in "keeping up with newlyproduced materials underline the importance 
of having available tiaterials dealing with, a substantial nujaber of different 
challenges at any particular school, Sonie respondents inade note of the ^act - 
that certain challenges were *'siuc.h better" than others. Activity at Scniiol B - 
was to a* great extent Lncepender.z of published USMES chautlenges* 

- " . ■ ■ ■ • ■.: ■ ^ i ' 

. ' > 112... 



USMSS Training and Inirial Experiences for Teachers 
■ . ■ ■ • /•:.-.' 

Three general observations ndghr be made concerning; pSMES - training and 
early e^^rience; | : : 

• It vas the most experienced respondents who were |:^:ost iJ^ 

by the need for taining in DSMES* Thus, it woxild ^PP^^r that 

one of the aost significant aspects of gaining experience in USMES 

is beccsaing aware of the full scope of the^ prograiin. . 

* ^. t ; 

• Many respondents, even those regarded by oxir.^ invejstigatpr as 
successful teachers / reported being frightened by; USMES -when 
they began to use it — USMES was ""a little scary at fir^tV" 
teachers were ''a .little shaXy about getting into new'tinits," or 
••reluctant to let kids loose. This seems to be a general sub- 
jective phenomenon , and indicates a need, on the part" of new USMES 
teachers, for a ce.rtaijr degree of eniotional support. 

m Most respondents who had experience with USMES national workshops 
' felt that these workshops had been more effective as a training 
procedure than whatever neams were locally available to- potential 
USMES teachers on-site sxibj>ecuently. They did feel, however, that 
local neans could be used to train new teachers* 

Overall Assessaient of USMES 

Respondents who offered an overall assessment of, the USMES program were, 
in general, quite positive. This is of course, not surprising, since the 
interviewer was the project director under whom USMES was developed. One 
aspect of the responses offered does seem worth remarking on, however. Re- 
spondents who had done USMES for socie time, and who still felt positive about 
the program, generally felt more positive than anyone else,, and assigned to 

" . USMES a sweeping role in their overall methods of teachyig — -USMES was "a way 
of life a teacher would "always use USMSS," and many others. This does not, 
at first sight, appear strange. Naturally, those -who continue longest in a 
program might likely be those who like it best. However, certain possible 
classes of respondents seemed to be missing, such as: the wildly enthusi- 
astic new USMES teacher; the experienced teacher who had settled down using 

^ USMES in a continued, limited way; the respondent who didn't particularly 
enjoy -USMSS but found it worked well; and matter-of-factly intended to con- 
tinue using it; etc/ This is^ of course, consistent with the picture pro- 
jected by developers and respondents alike that USMES is a rewarding, 
demanding, pervasive program, . capable cf taking an ic:5>ortant place in the 
professional life of a teacher but oquiring time to achieve fiill x:iastery. 




USHBS AND THE ^SOITABLE STDDENT" 



One. of the most important .issues in planning an USMES xmplementation 
is, simply: for what students ethnically r socially^ in terms of grade 
levels in terms of aptitude, etc-) is USMES most effective? School Study 
respondents had little to say about ethnic and -social variables # but did 
.comment about grade level and scholastic aptitude*' 

Just as the statistical data in Peart I of this study failed', to. show — 
either- that USMES was more successful with younger ^ or with older ^ stu- 
dents r so respondents dLnterviewed were divided in this matter* USMES was 
reported variously to be "best for grades 3 through 6^ "best for older 
students^ ""best for lower level students," "satisfactory with kindergarten 
students f" etc* The only view which emerged consistently, and was not con- 
tradicted, seems (strangely enough) to be the particular view that first 
grade DSMES yields less satisfactory results than that done in other grades, 
^ including^ kindergarten. This rather surprising generalization is consistent 
with the ds^ta analyzed in Part I of this study— only 9 out of 1043 sessions 
reported, on were first grade sessions, cind an unusually large proportion of 
these were judged '"relatively unsuccessful" in terms of the reporting criteria 
used. , ^ " 

\ ^ ' , .. 

Respondents were divided on the -issue of whether USMES was best for 
brighter, or for slower students, 'in general, ,the less privileged student 
pppulations from ' (Schools E and .D) seemed to give teachers the impression 
that USMES worked best with "brighter" -or^/'mDre mature"/students^ The school o 
whose studeiits were most privileged (and perhaps academically most talented) , 
School A, seented to convince its teachers that, USMES worked best with . "slower 
students, or students with learning problems. This may or may not reflect in. 
some general way the, attitudes of teachers- to more or less privileged popula- 
tions of students. ^ 
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USMES AM) THE "SUITABLE SCHOOL ENVIRONMENT' 



■\ /t^^ PfisM^ producing this study has been to afford teachers, 

principals/ and. school, district administrators with information for improv- 
ing USMES as /it is/ locally implemented, a secondary adLm has been to gain an 
understanding of where! US^ is likely to thrive and where (perhaps) it should 
not be attempted. * ' 

"TurnQver*^ of Students and Staff I 

It is easiest to do good^ USMES if the turnover rate among^ staff and 
students is quite low-.- Schoo^ E, an example whare this is the case, shows 
how .very good results can arise where these conditions are' met. A great deal 
of successful USMES is done a-t, School E with small e^^ense,. little disruption 
of school operation, and a great deal of mutual support among staff . This is 
not surprising^ First, students who have become familiar wix:h USMES through 
doing- several challenges seem to become "good at it," and. to profit more from 
subsequent challenges than inexperienced students: Second, learning to.tea^ch 
USMES takes, a substantial, amount of experience ; if most of the teachers at 

V a ^particular USMES installation are only present for a short time, then it 
will necessarily be true that only a small riTjmber of really skillsul USMES ^ 
teachers are available at any particular time. Also, and to some extent in- 
dependent of the preceding, there appears to be something like- a "critical 
/bass" effect which pertains, to the continued training and support, of new USMES 
teachers. Thus, it is extremely helpful for an inexperienced USMES teacher to 
be within easy ready of both practical support (a condition which is met where 
/there are highly experienced USMES teachers) and emotional support (a condition 
which is met where there are relatively many USMES teachers present) . Third, 
it is not only USfffiS teaching per se , but also the "adaptation" of USMES to. 
any particular, school environment, which must be learned; this adaptation is 

.\complex: because USMES is complex. Therefore evjsn a very experienced USMES 
teacher coming to a new school at which USMES is used, may be for a time less 
effective than another teacher who is familiar with both school and program. 

A. stable population of stu<3ents is fai. less critical to the successful 
performance of USMES than a stable group "^of teachers and administrators. In- 
deed, one of the chief reasons for the introduction of USMES at School B was 
to treat the alienation, discipline, and morale problems ingendered by the 
high turnover rate among School B students. 

: Stability among 'staff members is critical. The principal of School D, 
for example, was motivated by this very consideration when he used his dis- ' 
cretibnary powers to keep USMES teachers from, being transferred Out of his 
school, despite the hard feelings which might (and did) ensue. One most 
serious threat to the continued success of USMES at Sclipol B is thaty if the 
principal leaves School B, the USMES implementation theire may be very seri- 
ously weakened. The recently high turnover rate of Tieaihers at^School A 
has had a very bad effect on USMES at that school. Of course, if USMES was: a 
commonly used school program, the effect of staff t^Irnover would be much less- 
serious. / / • ; 



local Attitudes Towards Basic Skills Instrriction' 



One of the inost serious problems encountered by amy school was the 
preemptive effect of very consejnrative attitudes, locally held/ on instruc- 
tion in basic skills. Particuleorly Schools C and A were restricted in their 
USMES practice by this situation. However, it was by. no means clear that a 
vigorous local einiphasis on traditional basic skills- instruction posed an, 
insuperable obstacle to the development of a strong USMES program- For ex- 
ample, we saw some indication that strong "back-to-basics tendencies were 
present in the community containing School b. Yet, perhaps because of the 
diplomacy of School D's principal and perhaps because USMES at his school is 
an, integral part of a program which also provides highly-structured teaching. 
School was highly successful in having its USMES work supported. 

Thus, strong local emphasis on traditional basic skills instruction 
seemed not to rule out successful USMES, but did create a situation in which 
positive action oh the part of the school's principal was required. 




SUMMAEY 



Some of the issues discussed in this section are: 

• USMES and Parents. Parents at the five schools vary dramatically 

in: s . . • 

- attitudes towards non-^graded activity * . 

- expectations of children 

- trust of the local school 

- desire for constant monitoring of students ' progress 

interactions between parents and programs such as USMES are complex. 
Fluctuations in the four variables above can "maJce^' or "ruin" a 
particular USMES implementation* 

» Teachers ' conceptions of USMES . Mosr teachers ' vlrews of USMES seem 
fundamentally correct/ but incomplete when compared with the views 
held by program developers. This is believed to affect USMES teach- 
ing in a number of subtle ways. 

» Teachers* opinions concerning USMES. Teachers' opinions of USMES 
are usually quite positive. Occasionally they cire negative. 
Virtually no respondents,. were "lukewarm" about USMES. Thez:e. is 
considerable variability in teachers' opinions in the areas of 
basic skills, cxarriculum correlation, teacher training, an<5 student 
autonomy. The causes of this varicibility are complex.* 

► The "suitable" USMES student. There is a great deal of disagreement 
concerning just what sort of student is likely to profit most from 
USMES. Interview reports 'make it cleetr that no simple formulation, 
such as "USMES is best for brighter students," "USMES is best for 
older students*" "USMES is best for disadvantaged students," etc . , 
will suffice. - ■ . \ 

> The "suitable" school for USMES. Staff turnover and local attitudes 
towards basic skills instruction are particularly important factors. 
A high rate of staff turnover can be quite harmful, even in an other- 
wise satisfactory environment, unless an entire district is "saturated" 
with USMES. Local emphasis on basic skills per se is not a serious 
obstacle; however, a local basic skills emphasis does require positive 
action on the part of the school principal to justify the .-role of USMES; 
in basic skills instruction. 
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APPENDIX A: OUTLINE Q? PRINCIPAL INTjSKVTEW 



a) WHAT IMPACT DID YOOR USKES PROGRAH HAVE IN THE AREAS BELOW? 

b) WHAT "•PROCEDURES'" WERE INSTITUTED IN THESE AREAS IN ORDER TO CARRT 
GOT YOUR USMES PROGRA?i? IN ORDER TO AI4XW OTHER PROGRAHS TO 
COSITINUK WITHOUT INTERFERENCE? 

c) HOW SUCCESSFUL i^ERE THESE PROCEDURES? WHAT WOULD YOU DO DIFjPERENTLY 
NEXT TIKE—WHAT ADVICE MOULD YOU GIVE TO OTHERS? 



SCHEDULING—providing for rifiie that is adequate in terms of 
frequency, diiration (team teaching; use of extra tiisie during 
recess lunch zinie) ^ and flexibility {e*g^, vhen an extra half 
hour is needed for USMES). Scheduling changes of other subjects. " 

• THE RESll^OF THE CUHRICuLUH — interaction between USMES and other 
subject areAs; constraints by district and/or school; changes 
■nade to school or district curricolua. 

• SPACE — placement of Design Lab facilities in classrooms or school; 
freedom of movement of kids, ability to do tasks outside school 
property. - ■ , - ^ 

,-9*- • 

• FINANCES --De sign Lab supplies; written naterials; additional 
personnel; savings on other texts and materials • * 

STAFF PLANNING — choice of units affected by previous units; 
meetings among teachers- 

STAFF TRAINING — information/training for other teachers^ aides ^ 
and student teachers. Initial team trained by USMES. 

USE OF PERSOK^L — change in roles / new assignments. 

COOPEPATION — "HARMONY" (among teachers, students, principal, 
custodian; parents, school board, conmunity) . 

COMMUNICATIONS (for planning as well as information)— among 
teachers, students, principal,: custodyan; parents, school board 
community. ^ 

STUDElir ASSESSMENT PROCEDUl^— recording. s.tudent activities ; report- 
ing to parents. - 

ACCX)tniTABILITy PROCEDURES — reporting. to principal, district 
administrators, school board, and comimjnity- 

OTHER AREAS , - . 
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2. Describe the following factors {Interviewer: Note any relationships 
betmen the need for special procedures ^ or their success or, failure, 
and these facers*} 

" m DESCRIPnOS OS^ THE SCEOOI* — location, size, districr orgaiiizAtion. 

, e ISKOGSAPHICS OF THE CXStMCSITISS ASD STUUESTZS. 

e ATTITUDSS — of administrators # teachers, parents^ or others toward 
innovation, structure, or other broad aspects of school philosophy, 

• METHODS — generally used to introduce nev curricula into the sciKX)!. 

m WBY SCHOOL BECAME I?rvOLVED JJti USMES — history of involve»ent, aaotiva- 
tion of teachers and adrainistrators*^ 

e TYPE OF USKSS TH&INING — received by the teachers and adninistxators. 
Ronnie was at Hardy School S.T.W* (see page 4, Staff Training) > 

• HOW DS>ES IS IKPLEMEN7E0 IN THE SCHOOL — Design Lab facilities, units 
taught, grade levels^ tirse periods, nusber of OSMES teachers, USKES 
rwiterials available, support from adainistrators and parents* 

• PLACE OF USMES IN CtmRICULUM— as science, interdisciplinary, sup- 
plesaentary, or core program. What do you want students to gain 
frosa their US>S£S experience? Which of these areas are »ost impor- 
tant to you? . . " " 

. # C?rHER FACTORS. . 



CENERAL QUESTIONS 



3* What seens to be the effect of USi^ on the schcol in general? 



What seens to be the effect of USyrES on the students in general? 



5^ What is the future of USMES at your schcol? 



6- How vould USMES have to be different to znake it fit better into your 
^hdol program? What is year pcxscna DSMSS at your school? 
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: 1. Type of classrooo. S€lf-conrai,ned? Sccse Jtids ail the t::?^? 
. Iiidivieaal or self-paced vorSt? 

2* What prograas do yc;i use is aath, iancr^,gc arrs, ecc, —before 
and after USMES? 

•3. .Schedsiiing before d»d after USMZS. 

-4. "De you have enouafe rise? The right clrscice of si=vt> <flexlblli'Cy>? . 
5* z>id^ ycu keep any record of Jcids or class problea-solvisg experience? 

6. Grading zxui parent report. for=s. 

7. aisportinc- to principal or district— accoontability., 
S. Parent inv^Ires>ent. 

9, Staff Reetincs? Correlation of each class tJSMES progras.- Kaunagtaaent 
systes. 

10. CSXSS correlated with district or school goals or objectives publicl"/- 
Cor^traints Zxcsz. sci^ool, district, or state. 

11. fiovf is Design Lab rur*? How does it vork? 

13-- Reladv.*-iS betveen USMSS teachers anc rrOr.-CS>SS» principal , custodian^ 

14. Pcr3on^i opiniori of US*^ES, Sees ycu;r GS>C£S differ frori stainstre-ari 
USMES? 

15* If you- s'tiopp*?^^ why? 
16* Heccrsiendations — 



